2023-07-22 00:06:12,552 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 00:06:12,822 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f 2023-07-22 00:06:12,822 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-22 00:06:12,823 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-22 00:06:12,870 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 00:06:13,139 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 00:06:13,139 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3, deleteOnExit=true 2023-07-22 00:06:13,139 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 00:06:13,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/test.cache.data in system properties and HBase conf 2023-07-22 00:06:13,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 00:06:13,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop.log.dir in system properties and HBase conf 2023-07-22 00:06:13,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 00:06:13,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 00:06:13,142 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 00:06:13,459 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 00:06:13,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:13,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:13,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 00:06:13,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:13,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 00:06:13,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 00:06:13,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:13,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:13,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 00:06:13,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/nfs.dump.dir in system properties and HBase conf 2023-07-22 00:06:13,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir in system properties and HBase conf 2023-07-22 00:06:13,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:13,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 00:06:13,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 00:06:14,075 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 00:06:14,079 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 00:06:14,357 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 00:06:14,561 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 00:06:14,579 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:14,613 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:14,653 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_localhost_45981_hdfs____fzu83f/webapp 2023-07-22 00:06:14,795 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45981 2023-07-22 00:06:14,836 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 00:06:14,836 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 00:06:15,438 WARN [Listener at localhost/35929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:15,548 WARN [Listener at localhost/35929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:15,575 WARN [Listener at localhost/35929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:15,584 INFO [Listener at localhost/35929] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:15,592 INFO [Listener at localhost/35929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_localhost_40695_datanode____.7t4sw3/webapp 2023-07-22 00:06:15,734 INFO [Listener at localhost/35929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40695 2023-07-22 00:06:16,245 WARN [Listener at localhost/41031] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,270 WARN [Listener at localhost/41031] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:16,278 WARN [Listener at localhost/41031] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:16,280 INFO [Listener at localhost/41031] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:16,291 INFO [Listener at localhost/41031] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_localhost_33159_datanode____.o31s9w/webapp 2023-07-22 00:06:16,412 INFO [Listener at localhost/41031] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33159 2023-07-22 00:06:16,428 WARN [Listener at localhost/32893] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,475 WARN [Listener at localhost/32893] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:16,479 WARN [Listener at localhost/32893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:16,482 INFO [Listener at localhost/32893] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:16,486 INFO [Listener at localhost/32893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_localhost_44185_datanode____.ftj8a3/webapp 2023-07-22 00:06:16,637 INFO [Listener at localhost/32893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44185 2023-07-22 00:06:16,678 WARN [Listener at localhost/40587] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,907 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x577459f5cfe23d17: Processing first storage report for DS-e2a9fe1d-0eef-4798-ad3e-889721f14300 from datanode e27027df-ceb6-41aa-b614-06af873112c1 2023-07-22 00:06:16,909 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x577459f5cfe23d17: from storage DS-e2a9fe1d-0eef-4798-ad3e-889721f14300 node DatanodeRegistration(127.0.0.1:45353, datanodeUuid=e27027df-ceb6-41aa-b614-06af873112c1, infoPort=38283, infoSecurePort=0, ipcPort=32893, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x839ab0352ee96037: Processing first storage report for DS-3c151c0e-85cd-477d-9871-44d5afe4a906 from datanode 23f9e004-773f-4725-be85-3ae382f50c39 2023-07-22 00:06:16,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x839ab0352ee96037: from storage DS-3c151c0e-85cd-477d-9871-44d5afe4a906 node DatanodeRegistration(127.0.0.1:39839, datanodeUuid=23f9e004-773f-4725-be85-3ae382f50c39, infoPort=38769, infoSecurePort=0, ipcPort=41031, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x577459f5cfe23d17: Processing first storage report for DS-be20cfda-f1b4-4002-aedb-6264edfa73a3 from datanode e27027df-ceb6-41aa-b614-06af873112c1 2023-07-22 00:06:16,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x577459f5cfe23d17: from storage DS-be20cfda-f1b4-4002-aedb-6264edfa73a3 node DatanodeRegistration(127.0.0.1:45353, datanodeUuid=e27027df-ceb6-41aa-b614-06af873112c1, infoPort=38283, infoSecurePort=0, ipcPort=32893, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x839ab0352ee96037: Processing first storage report for DS-2a924f83-d2d2-4574-8e16-1836df6a0a47 from datanode 23f9e004-773f-4725-be85-3ae382f50c39 2023-07-22 00:06:16,911 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x839ab0352ee96037: from storage DS-2a924f83-d2d2-4574-8e16-1836df6a0a47 node DatanodeRegistration(127.0.0.1:39839, datanodeUuid=23f9e004-773f-4725-be85-3ae382f50c39, infoPort=38769, infoSecurePort=0, ipcPort=41031, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,928 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ae1ebf66c2289a5: Processing first storage report for DS-3c388235-484c-44f3-bdd3-079a03a95320 from datanode 457ced63-5212-43dc-b2ae-5c8b38a67f3a 2023-07-22 00:06:16,928 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ae1ebf66c2289a5: from storage DS-3c388235-484c-44f3-bdd3-079a03a95320 node DatanodeRegistration(127.0.0.1:38027, datanodeUuid=457ced63-5212-43dc-b2ae-5c8b38a67f3a, infoPort=45705, infoSecurePort=0, ipcPort=40587, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,929 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ae1ebf66c2289a5: Processing first storage report for DS-d20fd8e5-06ca-485d-810f-42e386390c42 from datanode 457ced63-5212-43dc-b2ae-5c8b38a67f3a 2023-07-22 00:06:16,929 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ae1ebf66c2289a5: from storage DS-d20fd8e5-06ca-485d-810f-42e386390c42 node DatanodeRegistration(127.0.0.1:38027, datanodeUuid=457ced63-5212-43dc-b2ae-5c8b38a67f3a, infoPort=45705, infoSecurePort=0, ipcPort=40587, storageInfo=lv=-57;cid=testClusterID;nsid=1679730767;c=1689984374151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:17,140 DEBUG [Listener at localhost/40587] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f 2023-07-22 00:06:17,226 INFO [Listener at localhost/40587] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/zookeeper_0, clientPort=55465, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 00:06:17,246 INFO [Listener at localhost/40587] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55465 2023-07-22 00:06:17,258 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:17,261 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:17,954 INFO [Listener at localhost/40587] util.FSUtils(471): Created version file at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 with version=8 2023-07-22 00:06:17,955 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/hbase-staging 2023-07-22 00:06:18,339 INFO [Listener at localhost/40587] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 00:06:18,922 INFO [Listener at localhost/40587] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:18,961 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:18,962 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:18,962 INFO [Listener at localhost/40587] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:18,962 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:18,962 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,123 INFO [Listener at localhost/40587] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,221 DEBUG [Listener at localhost/40587] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 00:06:19,328 INFO [Listener at localhost/40587] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34721 2023-07-22 00:06:19,344 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,346 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,368 INFO [Listener at localhost/40587] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34721 connecting to ZooKeeper ensemble=127.0.0.1:55465 2023-07-22 00:06:19,422 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:347210x0, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34721-0x1018a59a4790000 connected 2023-07-22 00:06:19,470 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,471 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,488 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,503 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34721 2023-07-22 00:06:19,503 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34721 2023-07-22 00:06:19,503 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34721 2023-07-22 00:06:19,505 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34721 2023-07-22 00:06:19,505 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34721 2023-07-22 00:06:19,512 INFO [Listener at localhost/40587] master.HMaster(444): hbase.rootdir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, hbase.cluster.distributed=false 2023-07-22 00:06:19,583 INFO [Listener at localhost/40587] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,583 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,583 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,583 INFO [Listener at localhost/40587] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,584 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,584 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,589 INFO [Listener at localhost/40587] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,595 INFO [Listener at localhost/40587] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37101 2023-07-22 00:06:19,598 INFO [Listener at localhost/40587] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,608 INFO [Listener at localhost/40587] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 00:06:19,609 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,612 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,615 INFO [Listener at localhost/40587] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37101 connecting to ZooKeeper ensemble=127.0.0.1:55465 2023-07-22 00:06:19,620 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:371010x0, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,622 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:371010x0, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,623 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:371010x0, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37101-0x1018a59a4790001 connected 2023-07-22 00:06:19,624 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,627 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37101 2023-07-22 00:06:19,627 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37101 2023-07-22 00:06:19,627 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37101 2023-07-22 00:06:19,631 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37101 2023-07-22 00:06:19,632 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37101 2023-07-22 00:06:19,651 INFO [Listener at localhost/40587] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,651 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,651 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,652 INFO [Listener at localhost/40587] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,652 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,652 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,653 INFO [Listener at localhost/40587] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,655 INFO [Listener at localhost/40587] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40135 2023-07-22 00:06:19,655 INFO [Listener at localhost/40587] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,656 INFO [Listener at localhost/40587] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 00:06:19,658 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,661 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,664 INFO [Listener at localhost/40587] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40135 connecting to ZooKeeper ensemble=127.0.0.1:55465 2023-07-22 00:06:19,668 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:401350x0, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,670 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:401350x0, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40135-0x1018a59a4790002 connected 2023-07-22 00:06:19,671 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,672 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,679 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40135 2023-07-22 00:06:19,679 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40135 2023-07-22 00:06:19,679 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40135 2023-07-22 00:06:19,681 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40135 2023-07-22 00:06:19,682 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40135 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,696 INFO [Listener at localhost/40587] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,697 INFO [Listener at localhost/40587] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,698 INFO [Listener at localhost/40587] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45387 2023-07-22 00:06:19,699 INFO [Listener at localhost/40587] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,700 INFO [Listener at localhost/40587] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 00:06:19,701 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,703 INFO [Listener at localhost/40587] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,705 INFO [Listener at localhost/40587] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45387 connecting to ZooKeeper ensemble=127.0.0.1:55465 2023-07-22 00:06:19,711 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:453870x0, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,712 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:453870x0, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45387-0x1018a59a4790003 connected 2023-07-22 00:06:19,717 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,719 DEBUG [Listener at localhost/40587] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,731 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-22 00:06:19,731 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45387 2023-07-22 00:06:19,734 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45387 2023-07-22 00:06:19,742 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-22 00:06:19,742 DEBUG [Listener at localhost/40587] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45387 2023-07-22 00:06:19,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:19,755 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 00:06:19,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:19,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:19,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 00:06:19,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 00:06:19,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34721,1689984378142 from backup master directory 2023-07-22 00:06:19,794 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:19,794 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 00:06:19,795 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:19,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:19,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 00:06:19,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 00:06:19,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/hbase.id with ID: 4e4ddb76-4cfa-4862-b387-3b564fca4398 2023-07-22 00:06:19,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6004cd9c to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:20,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31050f51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:20,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:20,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 00:06:20,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 00:06:20,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 00:06:20,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:20,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store-tmp 2023-07-22 00:06:20,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:20,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 00:06:20,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 00:06:20,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:06:20,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/WALs/jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:20,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34721%2C1689984378142, suffix=, logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/WALs/jenkins-hbase4.apache.org,34721,1689984378142, archiveDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/oldWALs, maxLogs=10 2023-07-22 00:06:20,415 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK] 2023-07-22 00:06:20,415 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK] 2023-07-22 00:06:20,415 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK] 2023-07-22 00:06:20,424 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/WALs/jenkins-hbase4.apache.org,34721,1689984378142/jenkins-hbase4.apache.org%2C34721%2C1689984378142.1689984380324 2023-07-22 00:06:20,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK], DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK], DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK]] 2023-07-22 00:06:20,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:20,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:20,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,590 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,602 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 00:06:20,669 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 00:06:20,685 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:20,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:20,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72790219, jitterRate=0.08465878665447235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:20,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:06:20,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 00:06:20,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 00:06:20,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 00:06:20,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 00:06:20,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 00:06:20,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-22 00:06:20,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 00:06:20,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 00:06:20,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 00:06:20,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 00:06:20,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 00:06:20,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 00:06:20,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 00:06:20,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 00:06:20,918 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 00:06:20,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 00:06:20,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 00:06:20,938 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:20,938 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:20,938 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:20,939 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:20,939 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34721,1689984378142, sessionid=0x1018a59a4790000, setting cluster-up flag (Was=false) 2023-07-22 00:06:20,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 00:06:20,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:20,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 00:06:20,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:20,985 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp 2023-07-22 00:06:21,049 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(951): ClusterId : 4e4ddb76-4cfa-4862-b387-3b564fca4398 2023-07-22 00:06:21,049 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(951): ClusterId : 4e4ddb76-4cfa-4862-b387-3b564fca4398 2023-07-22 00:06:21,051 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(951): ClusterId : 4e4ddb76-4cfa-4862-b387-3b564fca4398 2023-07-22 00:06:21,058 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,058 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,060 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,067 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,067 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,067 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,067 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,070 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,070 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,071 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,071 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,073 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ReadOnlyZKClient(139): Connect 0x6ab8cf89 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,075 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ReadOnlyZKClient(139): Connect 0x5c879800 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,077 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,100 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ReadOnlyZKClient(139): Connect 0x1b454d3d to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 00:06:21,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 00:06:21,162 DEBUG [RS:0;jenkins-hbase4:37101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644cedad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,162 DEBUG [RS:1;jenkins-hbase4:40135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25463373, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,164 DEBUG [RS:0;jenkins-hbase4:37101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@137b9e60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,164 DEBUG [RS:1;jenkins-hbase4:40135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e8327ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,164 DEBUG [RS:2;jenkins-hbase4:45387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa4f0d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,167 DEBUG [RS:2;jenkins-hbase4:45387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eaf8669, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,196 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45387 2023-07-22 00:06:21,199 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40135 2023-07-22 00:06:21,205 INFO [RS:1;jenkins-hbase4:40135] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,205 INFO [RS:1;jenkins-hbase4:40135] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,205 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,207 INFO [RS:1;jenkins-hbase4:40135] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,212 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,208 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37101 2023-07-22 00:06:21,212 INFO [RS:0;jenkins-hbase4:37101] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,207 INFO [RS:2;jenkins-hbase4:45387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,212 INFO [RS:2;jenkins-hbase4:45387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,212 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,213 INFO [RS:2;jenkins-hbase4:45387] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,213 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,213 INFO [RS:0;jenkins-hbase4:37101] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,214 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,214 INFO [RS:0;jenkins-hbase4:37101] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,214 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,216 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34721,1689984378142 with isa=jenkins-hbase4.apache.org/172.31.14.131:40135, startcode=1689984379650 2023-07-22 00:06:21,217 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34721,1689984378142 with isa=jenkins-hbase4.apache.org/172.31.14.131:45387, startcode=1689984379695 2023-07-22 00:06:21,217 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34721,1689984378142 with isa=jenkins-hbase4.apache.org/172.31.14.131:37101, startcode=1689984379582 2023-07-22 00:06:21,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,251 DEBUG [RS:2;jenkins-hbase4:45387] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,251 DEBUG [RS:1;jenkins-hbase4:40135] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,253 DEBUG [RS:0;jenkins-hbase4:37101] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 00:06:21,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689984411274 2023-07-22 00:06:21,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 00:06:21,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 00:06:21,315 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,316 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 00:06:21,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 00:06:21,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 00:06:21,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 00:06:21,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 00:06:21,322 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:21,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 00:06:21,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 00:06:21,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 00:06:21,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 00:06:21,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 00:06:21,355 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52021, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,355 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45887, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381351,5,FailOnTimeoutGroup] 2023-07-22 00:06:21,355 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60543, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381365,5,FailOnTimeoutGroup] 2023-07-22 00:06:21,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 00:06:21,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34721] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,402 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34721] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,402 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34721] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,415 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:21,415 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:21,415 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:21,416 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35929 2023-07-22 00:06:21,416 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35929 2023-07-22 00:06:21,417 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,417 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35929 2023-07-22 00:06:21,418 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,419 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,437 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:21,437 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:06:21,438 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ZKUtil(162): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,438 WARN [RS:1;jenkins-hbase4:40135] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,439 INFO [RS:1;jenkins-hbase4:40135] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,440 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,440 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ZKUtil(162): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,440 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:21,440 WARN [RS:0;jenkins-hbase4:37101] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,440 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,441 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:21,441 INFO [RS:0;jenkins-hbase4:37101] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,441 WARN [RS:2;jenkins-hbase4:45387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,445 INFO [RS:2;jenkins-hbase4:45387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,442 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,447 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,447 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40135,1689984379650] 2023-07-22 00:06:21,453 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45387,1689984379695] 2023-07-22 00:06:21,453 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37101,1689984379582] 2023-07-22 00:06:21,475 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ZKUtil(162): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,475 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ZKUtil(162): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,475 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,476 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ZKUtil(162): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,476 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ZKUtil(162): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,477 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ZKUtil(162): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,477 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ZKUtil(162): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,478 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,478 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ZKUtil(162): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,494 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,494 DEBUG [RS:2;jenkins-hbase4:45387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,499 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,518 INFO [RS:2;jenkins-hbase4:45387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,518 INFO [RS:0;jenkins-hbase4:37101] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,519 INFO [RS:1;jenkins-hbase4:40135] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,521 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:21,527 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 00:06:21,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/info 2023-07-22 00:06:21,531 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 00:06:21,532 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,533 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 00:06:21,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:21,542 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 00:06:21,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 00:06:21,549 INFO [RS:0;jenkins-hbase4:37101] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/table 2023-07-22 00:06:21,564 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 00:06:21,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,568 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740 2023-07-22 00:06:21,567 INFO [RS:1;jenkins-hbase4:40135] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,569 INFO [RS:0;jenkins-hbase4:37101] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,571 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,567 INFO [RS:2;jenkins-hbase4:45387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,572 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740 2023-07-22 00:06:21,576 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 00:06:21,579 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 00:06:21,579 INFO [RS:1;jenkins-hbase4:40135] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,580 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,587 INFO [RS:2;jenkins-hbase4:45387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,595 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,580 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,602 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,604 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:21,604 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,607 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65729158, jitterRate=-0.020559221506118774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 00:06:21,608 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 00:06:21,608 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 00:06:21,608 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 00:06:21,608 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 00:06:21,608 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 00:06:21,608 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 00:06:21,612 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 00:06:21,612 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 00:06:21,617 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,618 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,618 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 00:06:21,618 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,618 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,618 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,618 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,618 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,619 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,619 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,620 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:0;jenkins-hbase4:37101] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,620 DEBUG [RS:1;jenkins-hbase4:40135] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,623 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,623 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,623 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,623 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,624 DEBUG [RS:2;jenkins-hbase4:45387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,630 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,634 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,635 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,635 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,643 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,643 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 00:06:21,644 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,644 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,645 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,675 INFO [RS:2;jenkins-hbase4:45387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,678 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45387,1689984379695-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,687 INFO [RS:0;jenkins-hbase4:37101] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,689 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37101,1689984379582-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,700 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 00:06:21,710 INFO [RS:1;jenkins-hbase4:40135] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,710 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40135,1689984379650-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,716 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 00:06:21,721 INFO [RS:2;jenkins-hbase4:45387] regionserver.Replication(203): jenkins-hbase4.apache.org,45387,1689984379695 started 2023-07-22 00:06:21,721 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45387,1689984379695, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45387, sessionid=0x1018a59a4790003 2023-07-22 00:06:21,721 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,721 DEBUG [RS:2;jenkins-hbase4:45387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,721 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45387,1689984379695' 2023-07-22 00:06:21,721 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,722 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,723 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,723 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,723 DEBUG [RS:2;jenkins-hbase4:45387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:21,723 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45387,1689984379695' 2023-07-22 00:06:21,723 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,724 DEBUG [RS:2;jenkins-hbase4:45387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,725 DEBUG [RS:2;jenkins-hbase4:45387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,725 INFO [RS:2;jenkins-hbase4:45387] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,725 INFO [RS:2;jenkins-hbase4:45387] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:21,727 INFO [RS:0;jenkins-hbase4:37101] regionserver.Replication(203): jenkins-hbase4.apache.org,37101,1689984379582 started 2023-07-22 00:06:21,727 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37101,1689984379582, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37101, sessionid=0x1018a59a4790001 2023-07-22 00:06:21,727 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,727 DEBUG [RS:0;jenkins-hbase4:37101] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,728 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37101,1689984379582' 2023-07-22 00:06:21,729 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,729 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,730 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,730 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,730 DEBUG [RS:0;jenkins-hbase4:37101] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:21,731 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37101,1689984379582' 2023-07-22 00:06:21,731 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,732 DEBUG [RS:0;jenkins-hbase4:37101] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,734 DEBUG [RS:0;jenkins-hbase4:37101] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,734 INFO [RS:0;jenkins-hbase4:37101] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,735 INFO [RS:0;jenkins-hbase4:37101] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:21,771 INFO [RS:1;jenkins-hbase4:40135] regionserver.Replication(203): jenkins-hbase4.apache.org,40135,1689984379650 started 2023-07-22 00:06:21,771 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40135,1689984379650, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40135, sessionid=0x1018a59a4790002 2023-07-22 00:06:21,772 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,772 DEBUG [RS:1;jenkins-hbase4:40135] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,772 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40135,1689984379650' 2023-07-22 00:06:21,772 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,773 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,774 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,774 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,774 DEBUG [RS:1;jenkins-hbase4:40135] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:21,774 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40135,1689984379650' 2023-07-22 00:06:21,774 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,775 DEBUG [RS:1;jenkins-hbase4:40135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,776 DEBUG [RS:1;jenkins-hbase4:40135] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,777 INFO [RS:1;jenkins-hbase4:40135] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,777 INFO [RS:1;jenkins-hbase4:40135] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:21,841 INFO [RS:0;jenkins-hbase4:37101] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37101%2C1689984379582, suffix=, logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,37101,1689984379582, archiveDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs, maxLogs=32 2023-07-22 00:06:21,841 INFO [RS:2;jenkins-hbase4:45387] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45387%2C1689984379695, suffix=, logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,45387,1689984379695, archiveDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs, maxLogs=32 2023-07-22 00:06:21,869 DEBUG [jenkins-hbase4:34721] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 00:06:21,875 DEBUG [jenkins-hbase4:34721] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:21,886 INFO [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40135%2C1689984379650, suffix=, logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,40135,1689984379650, archiveDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs, maxLogs=32 2023-07-22 00:06:21,887 DEBUG [jenkins-hbase4:34721] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:21,887 DEBUG [jenkins-hbase4:34721] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:21,887 DEBUG [jenkins-hbase4:34721] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:21,888 DEBUG [jenkins-hbase4:34721] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:21,902 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40135,1689984379650, state=OPENING 2023-07-22 00:06:21,915 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 00:06:21,920 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:21,920 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK] 2023-07-22 00:06:21,920 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 00:06:21,921 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK] 2023-07-22 00:06:21,964 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK] 2023-07-22 00:06:21,964 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK] 2023-07-22 00:06:21,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40135,1689984379650}] 2023-07-22 00:06:21,972 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK] 2023-07-22 00:06:21,973 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK] 2023-07-22 00:06:21,996 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK] 2023-07-22 00:06:21,996 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK] 2023-07-22 00:06:21,997 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK] 2023-07-22 00:06:21,999 INFO [RS:2;jenkins-hbase4:45387] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,45387,1689984379695/jenkins-hbase4.apache.org%2C45387%2C1689984379695.1689984381846 2023-07-22 00:06:22,003 INFO [RS:0;jenkins-hbase4:37101] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,37101,1689984379582/jenkins-hbase4.apache.org%2C37101%2C1689984379582.1689984381846 2023-07-22 00:06:22,006 DEBUG [RS:2;jenkins-hbase4:45387] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK], DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK], DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK]] 2023-07-22 00:06:22,010 DEBUG [RS:0;jenkins-hbase4:37101] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK], DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK], DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK]] 2023-07-22 00:06:22,016 INFO [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,40135,1689984379650/jenkins-hbase4.apache.org%2C40135%2C1689984379650.1689984381888 2023-07-22 00:06:22,017 DEBUG [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK], DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK], DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK]] 2023-07-22 00:06:22,188 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:22,191 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:22,197 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:22,211 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 00:06:22,212 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:22,216 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40135%2C1689984379650.meta, suffix=.meta, logDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,40135,1689984379650, archiveDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs, maxLogs=32 2023-07-22 00:06:22,243 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK] 2023-07-22 00:06:22,243 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK] 2023-07-22 00:06:22,243 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK] 2023-07-22 00:06:22,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/WALs/jenkins-hbase4.apache.org,40135,1689984379650/jenkins-hbase4.apache.org%2C40135%2C1689984379650.meta.1689984382218.meta 2023-07-22 00:06:22,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38027,DS-3c388235-484c-44f3-bdd3-079a03a95320,DISK], DatanodeInfoWithStorage[127.0.0.1:45353,DS-e2a9fe1d-0eef-4798-ad3e-889721f14300,DISK], DatanodeInfoWithStorage[127.0.0.1:39839,DS-3c151c0e-85cd-477d-9871-44d5afe4a906,DISK]] 2023-07-22 00:06:22,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:22,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 00:06:22,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:22,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 00:06:22,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 00:06:22,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 00:06:22,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 00:06:22,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:22,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 00:06:22,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 00:06:22,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 00:06:22,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/info 2023-07-22 00:06:22,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/info 2023-07-22 00:06:22,285 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 00:06:22,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 00:06:22,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:22,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:22,290 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 00:06:22,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 00:06:22,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/table 2023-07-22 00:06:22,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/table 2023-07-22 00:06:22,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 00:06:22,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740 2023-07-22 00:06:22,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740 2023-07-22 00:06:22,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 00:06:22,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 00:06:22,313 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69367794, jitterRate=0.033660680055618286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 00:06:22,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 00:06:22,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689984382177 2023-07-22 00:06:22,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 00:06:22,351 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 00:06:22,351 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40135,1689984379650, state=OPEN 2023-07-22 00:06:22,357 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 00:06:22,358 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 00:06:22,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 00:06:22,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40135,1689984379650 in 394 msec 2023-07-22 00:06:22,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 00:06:22,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 723 msec 2023-07-22 00:06:22,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2700 sec 2023-07-22 00:06:22,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689984382395, completionTime=-1 2023-07-22 00:06:22,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 00:06:22,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 00:06:22,497 DEBUG [hconnection-0x3b26ad62-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:22,500 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:22,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 00:06:22,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689984442534 2023-07-22 00:06:22,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689984502534 2023-07-22 00:06:22,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 137 msec 2023-07-22 00:06:22,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34721,1689984378142-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34721,1689984378142-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34721,1689984378142-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34721, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,587 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 00:06:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 00:06:22,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:22,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 00:06:22,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:22,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:22,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/namespace/824247b9a51097bdbc051855370286bf 2023-07-22 00:06:22,647 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/namespace/824247b9a51097bdbc051855370286bf empty. 2023-07-22 00:06:22,648 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/namespace/824247b9a51097bdbc051855370286bf 2023-07-22 00:06:22,648 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 00:06:22,694 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:22,697 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 824247b9a51097bdbc051855370286bf, NAME => 'hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 824247b9a51097bdbc051855370286bf, disabling compactions & flushes 2023-07-22 00:06:22,730 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. after waiting 0 ms 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:22,730 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:22,730 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 824247b9a51097bdbc051855370286bf: 2023-07-22 00:06:22,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:22,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984382740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984382740"}]},"ts":"1689984382740"} 2023-07-22 00:06:22,792 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 00:06:22,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:22,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984382796"}]},"ts":"1689984382796"} 2023-07-22 00:06:22,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 00:06:22,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:22,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:22,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:22,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:22,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:22,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=824247b9a51097bdbc051855370286bf, ASSIGN}] 2023-07-22 00:06:22,821 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=824247b9a51097bdbc051855370286bf, ASSIGN 2023-07-22 00:06:22,824 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=824247b9a51097bdbc051855370286bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:06:22,977 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:06:22,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=824247b9a51097bdbc051855370286bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:22,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984382978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984382978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984382978"}]},"ts":"1689984382978"} 2023-07-22 00:06:22,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 824247b9a51097bdbc051855370286bf, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:06:23,149 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:23,150 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:23,155 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:23,163 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:23,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 824247b9a51097bdbc051855370286bf, NAME => 'hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:23,164 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. service=AccessControlService 2023-07-22 00:06:23,164 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:23,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:23,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,167 INFO [StoreOpener-824247b9a51097bdbc051855370286bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,169 DEBUG [StoreOpener-824247b9a51097bdbc051855370286bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/info 2023-07-22 00:06:23,169 DEBUG [StoreOpener-824247b9a51097bdbc051855370286bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/info 2023-07-22 00:06:23,170 INFO [StoreOpener-824247b9a51097bdbc051855370286bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 824247b9a51097bdbc051855370286bf columnFamilyName info 2023-07-22 00:06:23,171 INFO [StoreOpener-824247b9a51097bdbc051855370286bf-1] regionserver.HStore(310): Store=824247b9a51097bdbc051855370286bf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:23,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 824247b9a51097bdbc051855370286bf 2023-07-22 00:06:23,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:23,182 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 824247b9a51097bdbc051855370286bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61716219, jitterRate=-0.0803566724061966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:23,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 824247b9a51097bdbc051855370286bf: 2023-07-22 00:06:23,185 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf., pid=6, masterSystemTime=1689984383149 2023-07-22 00:06:23,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:23,189 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:06:23,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=824247b9a51097bdbc051855370286bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:23,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984383190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984383190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984383190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984383190"}]},"ts":"1689984383190"} 2023-07-22 00:06:23,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 00:06:23,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 824247b9a51097bdbc051855370286bf, server=jenkins-hbase4.apache.org,37101,1689984379582 in 200 msec 2023-07-22 00:06:23,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 00:06:23,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=824247b9a51097bdbc051855370286bf, ASSIGN in 381 msec 2023-07-22 00:06:23,203 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:23,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984383203"}]},"ts":"1689984383203"} 2023-07-22 00:06:23,206 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 00:06:23,209 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:23,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 00:06:23,216 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,216 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:23,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 610 msec 2023-07-22 00:06:23,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:23,241 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:23,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 00:06:23,273 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-22 00:06:23,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 00:06:23,303 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 24 msec 2023-07-22 00:06:23,326 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 00:06:23,329 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 00:06:23,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.534sec 2023-07-22 00:06:23,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 00:06:23,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 00:06:23,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 00:06:23,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34721,1689984378142-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 00:06:23,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34721,1689984378142-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 00:06:23,362 DEBUG [Listener at localhost/40587] zookeeper.ReadOnlyZKClient(139): Connect 0x04d40e34 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:23,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:23,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 00:06:23,374 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:23,375 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:23,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 00:06:23,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,403 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,405 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb empty. 2023-07-22 00:06:23,407 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,407 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 00:06:23,408 DEBUG [Listener at localhost/40587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95b019e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:23,440 DEBUG [hconnection-0x789af62c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:23,473 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:23,478 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:06:23,478 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 00:06:23,478 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/test.cache.data in system properties and HBase conf 2023-07-22 00:06:23,478 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 00:06:23,478 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop.log.dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:23,479 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/nfs.dump.dir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir in system properties and HBase conf 2023-07-22 00:06:23,480 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:23,481 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 00:06:23,481 INFO [Listener at localhost/40587] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 00:06:23,481 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:23,487 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 875272fc4f8e08f07ac8c0249092d9eb, NAME => 'hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:23,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,536 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:23,539 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 875272fc4f8e08f07ac8c0249092d9eb, disabling compactions & flushes 2023-07-22 00:06:23,539 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,539 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,540 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. after waiting 0 ms 2023-07-22 00:06:23,540 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,540 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,540 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 875272fc4f8e08f07ac8c0249092d9eb: 2023-07-22 00:06:23,547 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:23,548 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984383548"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984383548"}]},"ts":"1689984383548"} 2023-07-22 00:06:23,555 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 00:06:23,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:23,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984383561"}]},"ts":"1689984383561"} 2023-07-22 00:06:23,564 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 00:06:23,570 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:23,574 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:23,574 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:23,574 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:23,574 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:23,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=875272fc4f8e08f07ac8c0249092d9eb, ASSIGN}] 2023-07-22 00:06:23,579 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=875272fc4f8e08f07ac8c0249092d9eb, ASSIGN 2023-07-22 00:06:23,582 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=875272fc4f8e08f07ac8c0249092d9eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:06:23,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,732 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:06:23,739 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=875272fc4f8e08f07ac8c0249092d9eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:23,740 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984383739"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984383739"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984383739"}]},"ts":"1689984383739"} 2023-07-22 00:06:23,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 875272fc4f8e08f07ac8c0249092d9eb, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:06:23,904 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 875272fc4f8e08f07ac8c0249092d9eb, NAME => 'hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:23,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. service=AccessControlService 2023-07-22 00:06:23,905 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:23,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:23,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,909 INFO [StoreOpener-875272fc4f8e08f07ac8c0249092d9eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,911 DEBUG [StoreOpener-875272fc4f8e08f07ac8c0249092d9eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/l 2023-07-22 00:06:23,911 DEBUG [StoreOpener-875272fc4f8e08f07ac8c0249092d9eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/l 2023-07-22 00:06:23,912 INFO [StoreOpener-875272fc4f8e08f07ac8c0249092d9eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 875272fc4f8e08f07ac8c0249092d9eb columnFamilyName l 2023-07-22 00:06:23,913 INFO [StoreOpener-875272fc4f8e08f07ac8c0249092d9eb-1] regionserver.HStore(310): Store=875272fc4f8e08f07ac8c0249092d9eb/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:23,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:06:23,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:23,940 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 875272fc4f8e08f07ac8c0249092d9eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65391844, jitterRate=-0.025585591793060303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:23,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 875272fc4f8e08f07ac8c0249092d9eb: 2023-07-22 00:06:23,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb., pid=11, masterSystemTime=1689984383898 2023-07-22 00:06:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,951 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:06:23,951 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=875272fc4f8e08f07ac8c0249092d9eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:23,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984383951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984383951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984383951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984383951"}]},"ts":"1689984383951"} 2023-07-22 00:06:23,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 00:06:23,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 875272fc4f8e08f07ac8c0249092d9eb, server=jenkins-hbase4.apache.org,37101,1689984379582 in 212 msec 2023-07-22 00:06:23,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 00:06:23,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=875272fc4f8e08f07ac8c0249092d9eb, ASSIGN in 387 msec 2023-07-22 00:06:23,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:23,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984383968"}]},"ts":"1689984383968"} 2023-07-22 00:06:23,971 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 00:06:23,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:23,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 611 msec 2023-07-22 00:06:23,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 00:06:24,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 00:06:24,812 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:25,135 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:25,140 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45369_jobhistory____.19axdu/webapp 2023-07-22 00:06:25,311 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 00:06:25,311 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:25,311 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:25,313 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:25,379 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:25,662 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:26,018 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 00:06:26,156 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45369 2023-07-22 00:06:26,311 WARN [Listener at jenkins-hbase4.apache.org/33051] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:26,684 WARN [Listener at jenkins-hbase4.apache.org/33051] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:26,685 INFO [Listener at jenkins-hbase4.apache.org/33051] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:26,692 INFO [Listener at jenkins-hbase4.apache.org/33051] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38075_cluster____9e10u3/webapp 2023-07-22 00:06:26,789 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:26,789 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 00:06:26,790 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:26,790 INFO [Listener at jenkins-hbase4.apache.org/33051] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:26,802 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:27,029 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:27,153 INFO [Listener at jenkins-hbase4.apache.org/33051] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:27,162 INFO [Listener at jenkins-hbase4.apache.org/33051] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38075 2023-07-22 00:06:27,738 WARN [Listener at jenkins-hbase4.apache.org/37573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:27,765 WARN [Listener at jenkins-hbase4.apache.org/37573] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:27,765 INFO [Listener at jenkins-hbase4.apache.org/37573] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:27,773 INFO [Listener at jenkins-hbase4.apache.org/37573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43473_node____z1ltv3/webapp 2023-07-22 00:06:27,830 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 00:06:27,831 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:27,831 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:27,831 INFO [Listener at jenkins-hbase4.apache.org/37573] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:27,839 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:27,861 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:27,918 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:28,037 INFO [Listener at jenkins-hbase4.apache.org/37573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,062 INFO [Listener at jenkins-hbase4.apache.org/37573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43473 2023-07-22 00:06:28,181 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 00:06:28,183 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 00:06:28,184 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 00:06:28,334 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,335 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 00:06:28,336 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,336 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 00:06:28,336 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 00:06:28,336 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 00:06:28,336 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,336 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 00:06:28,336 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 00:06:28,336 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 00:06:28,372 WARN [Listener at jenkins-hbase4.apache.org/36243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:28,378 WARN [Listener at jenkins-hbase4.apache.org/36243] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:28,379 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:28,387 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34911_node____.r9xiga/webapp 2023-07-22 00:06:28,448 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 00:06:28,448 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:28,448 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:28,448 INFO [Listener at jenkins-hbase4.apache.org/36243] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:28,458 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,481 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,579 INFO [Listener at jenkins-hbase4.apache.org/36243] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,590 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34911 2023-07-22 00:06:28,620 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 00:06:28,622 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:28,692 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=171, AvailableMemoryMB=9443 2023-07-22 00:06:28,692 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-22 00:06:28,710 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 00:06:28,719 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 00:06:28,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:06:28,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:28,737 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:28,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 00:06:28,741 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:28,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:28,747 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:28,749 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 empty. 2023-07-22 00:06:28,750 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:28,763 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:28,765 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 empty. 2023-07-22 00:06:28,767 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:28,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 00:06:28,800 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:28,801 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ac946a91c21936155c03b35d735f8006, NAME => 'testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:28,802 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8f16654c06056eeeaf858da64b381104, NAME => 'testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:28,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:28,858 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:28,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ac946a91c21936155c03b35d735f8006, disabling compactions & flushes 2023-07-22 00:06:28,859 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:28,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:28,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. after waiting 0 ms 2023-07-22 00:06:28,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:28,859 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:28,859 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ac946a91c21936155c03b35d735f8006: 2023-07-22 00:06:29,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:29,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:29,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8f16654c06056eeeaf858da64b381104, disabling compactions & flushes 2023-07-22 00:06:29,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. after waiting 0 ms 2023-07-22 00:06:29,255 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,256 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,256 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8f16654c06056eeeaf858da64b381104: 2023-07-22 00:06:29,262 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:29,264 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984389263"}]},"ts":"1689984389263"} 2023-07-22 00:06:29,264 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984389263"}]},"ts":"1689984389263"} 2023-07-22 00:06:29,323 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:06:29,325 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:29,326 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984389325"}]},"ts":"1689984389325"} 2023-07-22 00:06:29,328 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 00:06:29,336 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:29,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:29,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:29,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:29,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:29,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, ASSIGN}] 2023-07-22 00:06:29,345 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, ASSIGN 2023-07-22 00:06:29,346 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:06:29,348 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, ASSIGN 2023-07-22 00:06:29,350 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40135,1689984379650; forceNewPlan=false, retain=false 2023-07-22 00:06:29,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:29,497 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:06:29,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ac946a91c21936155c03b35d735f8006, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:29,500 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8f16654c06056eeeaf858da64b381104, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:29,501 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984389500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984389500"}]},"ts":"1689984389500"} 2023-07-22 00:06:29,501 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984389500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984389500"}]},"ts":"1689984389500"} 2023-07-22 00:06:29,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure ac946a91c21936155c03b35d735f8006, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:06:29,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 8f16654c06056eeeaf858da64b381104, server=jenkins-hbase4.apache.org,40135,1689984379650}] 2023-07-22 00:06:29,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f16654c06056eeeaf858da64b381104, NAME => 'testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:06:29,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. service=AccessControlService 2023-07-22 00:06:29,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:29,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:29,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:29,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac946a91c21936155c03b35d735f8006, NAME => 'testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:06:29,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. service=AccessControlService 2023-07-22 00:06:29,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:29,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:29,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,693 INFO [StoreOpener-8f16654c06056eeeaf858da64b381104-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,694 INFO [StoreOpener-ac946a91c21936155c03b35d735f8006-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,696 DEBUG [StoreOpener-8f16654c06056eeeaf858da64b381104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf 2023-07-22 00:06:29,696 DEBUG [StoreOpener-8f16654c06056eeeaf858da64b381104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf 2023-07-22 00:06:29,698 DEBUG [StoreOpener-ac946a91c21936155c03b35d735f8006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf 2023-07-22 00:06:29,699 DEBUG [StoreOpener-ac946a91c21936155c03b35d735f8006-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf 2023-07-22 00:06:29,701 INFO [StoreOpener-8f16654c06056eeeaf858da64b381104-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f16654c06056eeeaf858da64b381104 columnFamilyName cf 2023-07-22 00:06:29,707 INFO [StoreOpener-ac946a91c21936155c03b35d735f8006-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac946a91c21936155c03b35d735f8006 columnFamilyName cf 2023-07-22 00:06:29,708 INFO [StoreOpener-8f16654c06056eeeaf858da64b381104-1] regionserver.HStore(310): Store=8f16654c06056eeeaf858da64b381104/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,720 INFO [StoreOpener-ac946a91c21936155c03b35d735f8006-1] regionserver.HStore(310): Store=ac946a91c21936155c03b35d735f8006/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:29,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:29,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:29,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:29,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac946a91c21936155c03b35d735f8006; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66931063, jitterRate=-0.002649441361427307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:29,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8f16654c06056eeeaf858da64b381104; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73666760, jitterRate=0.09772026538848877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac946a91c21936155c03b35d735f8006: 2023-07-22 00:06:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8f16654c06056eeeaf858da64b381104: 2023-07-22 00:06:29,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006., pid=15, masterSystemTime=1689984389658 2023-07-22 00:06:29,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104., pid=16, masterSystemTime=1689984389660 2023-07-22 00:06:29,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:29,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:29,754 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ac946a91c21936155c03b35d735f8006, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:29,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:29,754 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389754"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984389754"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984389754"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984389754"}]},"ts":"1689984389754"} 2023-07-22 00:06:29,755 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8f16654c06056eeeaf858da64b381104, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:29,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984389755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984389755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984389755"}]},"ts":"1689984389755"} 2023-07-22 00:06:29,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-22 00:06:29,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure ac946a91c21936155c03b35d735f8006, server=jenkins-hbase4.apache.org,37101,1689984379582 in 255 msec 2023-07-22 00:06:29,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-22 00:06:29,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 8f16654c06056eeeaf858da64b381104, server=jenkins-hbase4.apache.org,40135,1689984379650 in 256 msec 2023-07-22 00:06:29,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, ASSIGN in 433 msec 2023-07-22 00:06:29,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-22 00:06:29,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, ASSIGN in 431 msec 2023-07-22 00:06:29,782 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:29,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984389782"}]},"ts":"1689984389782"} 2023-07-22 00:06:29,790 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 00:06:29,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:29,801 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 00:06:29,814 DEBUG [hconnection-0x37c89b75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:29,818 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-22 00:06:29,829 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:29,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:29,869 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:29,869 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:29,869 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:29,869 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:29,870 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:29,885 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:29,885 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:29,885 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:29,885 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:29,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:29,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:29,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1580 sec 2023-07-22 00:06:29,893 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:29,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:30,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:30,867 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 00:06:30,871 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 00:06:30,872 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:30,875 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:30,896 DEBUG [hconnection-0x789af62c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:30,899 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:30,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:30,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984390916 (current time:1689984390916). 2023-07-22 00:06:30,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:30,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x510651c7 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:30,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c62ff3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:30,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:30,928 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:30,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x510651c7 to 127.0.0.1:55465 2023-07-22 00:06:30,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:30,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x2072c9d6 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:30,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7105, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:30,940 DEBUG [hconnection-0x1f4ff3be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:30,941 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:30,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:30,947 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:30,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2072c9d6 to 127.0.0.1:55465 2023-07-22 00:06:30,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:30,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:30,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:30,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:30,999 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,000 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689984991000 2023-07-22 00:06:31,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 00:06:31,003 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-22 00:06:31,005 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,006 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689984991006 2023-07-22 00:06:31,007 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:31,007 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:31,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,043 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 00:06:31,043 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,044 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 00:06:31,044 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 00:06:31,045 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,045 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,051 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,051 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,051 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,051 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,052 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,052 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,052 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,052 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,055 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,055 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,055 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,067 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,067 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,067 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,067 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,067 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,069 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,069 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,069 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,072 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,073 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,074 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,075 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de0755d[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de0755d[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:31,081 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 00:06:31,081 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,085 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:06:31,086 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,086 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:31,086 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,086 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,086 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:31,087 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. started... 2023-07-22 00:06:31,090 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,090 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,090 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:31,090 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. started... 2023-07-22 00:06:31,090 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,090 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,090 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,092 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac946a91c21936155c03b35d735f8006: 2023-07-22 00:06:31,092 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f16654c06056eeeaf858da64b381104: 2023-07-22 00:06:31,093 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,093 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,099 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,099 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,102 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:31,102 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:31,107 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,113 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:31,136 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. completed. 2023-07-22 00:06:31,136 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:31,137 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. completed. 2023-07-22 00:06:31,137 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,137 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:06:31,140 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,140 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,145 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,145 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,145 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,146 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40135,1689984379650': 2023-07-22 00:06:31,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 00:06:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:06:31,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 00:06:31,160 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 00:06:31,160 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:31,160 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:31,160 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,160 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:31,164 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,164 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,165 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,165 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,165 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,166 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,167 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,171 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,172 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,172 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,186 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,187 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,187 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:06:31,188 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:06:31,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,313 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,319 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:06:31,395 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 00:06:31,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,396 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689984391000Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689984391213 (+213 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689984391213Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689984391214 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689984391237 (+23 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689984391287 (+50 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689984391395 (+108 ms) 2023-07-22 00:06:31,398 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 396 msec 2023-07-22 00:06:31,619 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:31,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:31,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40135] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:31,645 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 00:06:31,645 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:31,645 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:31,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984391662 (current time:1689984391662). 2023-07-22 00:06:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:31,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x1d992f4d to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d1ecf9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,678 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d992f4d to 127.0.0.1:55465 2023-07-22 00:06:31,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x15da2dd4 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416d9b65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,693 DEBUG [hconnection-0x7a34cefb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,699 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,707 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15da2dd4 to 127.0.0.1:55465 2023-07-22 00:06:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:31,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:31,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,715 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,717 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689984991717 2023-07-22 00:06:31,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 00:06:31,719 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:31,719 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:31,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,723 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 11 msec 2023-07-22 00:06:31,729 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,731 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689984991731 2023-07-22 00:06:31,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 00:06:31,764 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 00:06:31,764 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,766 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 00:06:31,766 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 00:06:31,766 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,767 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,768 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,768 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,769 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,768 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,769 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,770 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,770 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,770 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,773 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,775 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,776 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,777 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,777 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,776 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,777 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,777 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,778 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,777 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,778 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,778 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,779 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,781 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,781 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,782 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,782 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,782 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,783 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,783 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,784 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,784 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:31,789 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 00:06:31,789 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:31,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,796 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,796 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,796 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,797 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,797 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. started... 2023-07-22 00:06:31,796 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,797 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,797 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:31,797 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ac946a91c21936155c03b35d735f8006 1/1 column families, dataSize=601 B heapSize=1.52 KB 2023-07-22 00:06:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,797 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:31,797 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. started... 2023-07-22 00:06:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:06:31,797 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8f16654c06056eeeaf858da64b381104 1/1 column families, dataSize=2.67 KB heapSize=6.02 KB 2023-07-22 00:06:31,801 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,801 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,801 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,820 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,822 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:31,971 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd 2023-07-22 00:06:31,972 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080 2023-07-22 00:06:32,014 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/.tmp/cf/d25e0b8dbd7e43839fe5a0435bb96a5b 2023-07-22 00:06:32,015 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=601, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/.tmp/cf/5cbd1f9d3f774ed7914a34d450036a52 2023-07-22 00:06:32,022 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:32,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:32,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:32,025 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:06:32,026 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/.tmp/cf/d25e0b8dbd7e43839fe5a0435bb96a5b as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b 2023-07-22 00:06:32,026 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/.tmp/cf/5cbd1f9d3f774ed7914a34d450036a52 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52 2023-07-22 00:06:32,038 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b, entries=41, sequenceid=6, filesize=11.8 K 2023-07-22 00:06:32,040 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52, entries=9, sequenceid=6, filesize=6.4 K 2023-07-22 00:06:32,044 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.67 KB/2735, heapSize ~6 KB/6144, currentSize=0 B/0 for 8f16654c06056eeeaf858da64b381104 in 246ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:32,044 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~601 B/601, heapSize ~1.50 KB/1536, currentSize=0 B/0 for ac946a91c21936155c03b35d735f8006 in 246ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:32,044 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 00:06:32,044 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 00:06:32,046 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f16654c06056eeeaf858da64b381104: 2023-07-22 00:06:32,046 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac946a91c21936155c03b35d735f8006: 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b] hfiles 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52] hfiles 2023-07-22 00:06:32,047 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:32,073 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. completed. 2023-07-22 00:06:32,073 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,073 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. completed. 2023-07-22 00:06:32,073 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:32,074 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:06:32,075 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,075 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:32,077 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,077 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:32,077 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:32,077 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40135,1689984379650': 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:06:32,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 00:06:32,088 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 00:06:32,088 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:32,088 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:32,088 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 00:06:32,088 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:32,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,091 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,092 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:32,093 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,095 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,095 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:32,096 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 00:06:32,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:06:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:32,108 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:32,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:32,108 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:32,109 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:32,110 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,110 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:32,110 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:32,110 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,110 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:32,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080] mob files 2023-07-22 00:06:32,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd 2023-07-22 00:06:32,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080 2023-07-22 00:06:32,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 00:06:32,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 00:06:32,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,248 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:32,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689984391717Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689984392126 (+409 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689984392126Loading Region manifests for snaptb0-testExportWithTargetName at 1689984392126Writing data manifest for snaptb0-testExportWithTargetName at 1689984392131 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689984392157 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689984392247 (+90 ms) 2023-07-22 00:06:32,250 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:32,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 532 msec 2023-07-22 00:06:32,325 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:32,329 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329 2023-07-22 00:06:32,329 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35929, tgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329, rawTgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:32,393 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:32,394 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-103116509_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 00:06:32,394 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 00:06:32,439 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 00:06:32,621 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,622 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,623 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,623 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,624 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,624 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,625 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,717 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-1823879538441148537.jar 2023-07-22 00:06:32,718 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,719 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,719 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,720 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,720 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,721 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,721 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:06:32,721 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:06:32,722 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:06:32,722 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:06:32,723 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:06:32,724 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:06:32,724 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:06:32,725 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:06:32,725 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:06:32,726 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:06:32,730 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,731 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,732 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:32,732 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,732 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,733 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:32,734 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:33,569 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:06:33,577 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 00:06:33,587 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-22 00:06:34,133 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:34,135 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:34,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:35,191 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:39,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:42,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:45,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:46,619 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:06:46,622 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:06:46,634 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 00:06:46,634 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:06:46,635 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:06:46,635 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 00:06:46,636 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 00:06:46,636 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 00:06:46,636 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/testExportWithTargetName 2023-07-22 00:06:46,637 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 00:06:46,637 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984392329/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 00:06:46,649 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 00:06:46,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 00:06:46,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:46,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984406667"}]},"ts":"1689984406667"} 2023-07-22 00:06:46,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:46,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 00:06:46,670 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 00:06:46,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, UNASSIGN}] 2023-07-22 00:06:46,674 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, UNASSIGN 2023-07-22 00:06:46,674 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, UNASSIGN 2023-07-22 00:06:46,675 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ac946a91c21936155c03b35d735f8006, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:46,675 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8f16654c06056eeeaf858da64b381104, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:46,675 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984406675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984406675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984406675"}]},"ts":"1689984406675"} 2023-07-22 00:06:46,675 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984406675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984406675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984406675"}]},"ts":"1689984406675"} 2023-07-22 00:06:46,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ac946a91c21936155c03b35d735f8006, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:06:46,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 8f16654c06056eeeaf858da64b381104, server=jenkins-hbase4.apache.org,40135,1689984379650}] 2023-07-22 00:06:46,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:46,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:46,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8f16654c06056eeeaf858da64b381104, disabling compactions & flushes 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac946a91c21936155c03b35d735f8006, disabling compactions & flushes 2023-07-22 00:06:46,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:46,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. after waiting 0 ms 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. after waiting 0 ms 2023-07-22 00:06:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:46,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:06:46,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:06:46,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:46,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:46,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006. 2023-07-22 00:06:46,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104. 2023-07-22 00:06:46,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac946a91c21936155c03b35d735f8006: 2023-07-22 00:06:46,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8f16654c06056eeeaf858da64b381104: 2023-07-22 00:06:46,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:46,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8f16654c06056eeeaf858da64b381104, regionState=CLOSED 2023-07-22 00:06:46,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984406857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984406857"}]},"ts":"1689984406857"} 2023-07-22 00:06:46,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:46,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ac946a91c21936155c03b35d735f8006, regionState=CLOSED 2023-07-22 00:06:46,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984406858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984406858"}]},"ts":"1689984406858"} 2023-07-22 00:06:46,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-22 00:06:46,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 8f16654c06056eeeaf858da64b381104, server=jenkins-hbase4.apache.org,40135,1689984379650 in 181 msec 2023-07-22 00:06:46,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-22 00:06:46,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ac946a91c21936155c03b35d735f8006, server=jenkins-hbase4.apache.org,37101,1689984379582 in 183 msec 2023-07-22 00:06:46,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8f16654c06056eeeaf858da64b381104, UNASSIGN in 190 msec 2023-07-22 00:06:46,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-22 00:06:46,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ac946a91c21936155c03b35d735f8006, UNASSIGN in 191 msec 2023-07-22 00:06:46,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984406868"}]},"ts":"1689984406868"} 2023-07-22 00:06:46,869 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 00:06:46,871 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 00:06:46,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 215 msec 2023-07-22 00:06:46,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:46,970 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 00:06:46,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 00:06:46,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:46,985 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:46,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 00:06:46,987 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:46,991 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 00:06:46,994 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:46,994 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:46,998 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/recovered.edits] 2023-07-22 00:06:46,998 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/recovered.edits] 2023-07-22 00:06:46,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:46,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:46,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:46,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,001 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,001 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,001 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 00:06:47,001 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:06:47,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 00:06:47,002 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:06:47,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 00:06:47,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 00:06:47,001 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,002 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:06:47,002 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:06:47,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 00:06:47,009 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/cf/5cbd1f9d3f774ed7914a34d450036a52 2023-07-22 00:06:47,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/cf/d25e0b8dbd7e43839fe5a0435bb96a5b 2023-07-22 00:06:47,014 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104/recovered.edits/9.seqid 2023-07-22 00:06:47,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006/recovered.edits/9.seqid 2023-07-22 00:06:47,015 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/8f16654c06056eeeaf858da64b381104 2023-07-22 00:06:47,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportWithTargetName/ac946a91c21936155c03b35d735f8006 2023-07-22 00:06:47,015 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 00:06:47,016 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 00:06:47,017 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-22 00:06:47,021 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307228661747d3d044d92861a50114331a7fd 2023-07-22 00:06:47,023 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230722b9151c4f042749d5ab6dd34bbc0e2080 2023-07-22 00:06:47,023 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 00:06:47,027 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,056 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 00:06:47,059 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 00:06:47,060 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,060 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 00:06:47,061 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984407061"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,061 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984407061"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:06:47,063 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ac946a91c21936155c03b35d735f8006, NAME => 'testtb-testExportWithTargetName,,1689984388727.ac946a91c21936155c03b35d735f8006.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8f16654c06056eeeaf858da64b381104, NAME => 'testtb-testExportWithTargetName,1,1689984388727.8f16654c06056eeeaf858da64b381104.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:06:47,063 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 00:06:47,064 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984407063"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,066 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 00:06:47,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 93 msec 2023-07-22 00:06:47,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 00:06:47,109 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 00:06:47,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 00:06:47,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:47,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 00:06:47,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 00:06:47,172 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 707) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:52934 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1202723390_1 at /127.0.0.1:40638 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1202723390_1 at /127.0.0.1:52906 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:40652 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:47006 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:44285 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:43255 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 271) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=7691 (was 9443) 2023-07-22 00:06:47,172 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-22 00:06:47,192 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=178, AvailableMemoryMB=7690 2023-07-22 00:06:47,192 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-22 00:06:47,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:06:47,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:06:47,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:47,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 00:06:47,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,200 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:47,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 empty. 2023-07-22 00:06:47,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 empty. 2023-07-22 00:06:47,205 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,205 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,205 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 00:06:47,224 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:47,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63173618d5dfe0f03cab1a26c8ecd2f4, NAME => 'testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:47,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a6450684bf64c08b858966cf31040888, NAME => 'testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:06:47,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 63173618d5dfe0f03cab1a26c8ecd2f4, disabling compactions & flushes 2023-07-22 00:06:47,251 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. after waiting 0 ms 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,251 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 63173618d5dfe0f03cab1a26c8ecd2f4: 2023-07-22 00:06:47,251 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a6450684bf64c08b858966cf31040888, disabling compactions & flushes 2023-07-22 00:06:47,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. after waiting 0 ms 2023-07-22 00:06:47,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,252 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a6450684bf64c08b858966cf31040888: 2023-07-22 00:06:47,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:47,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407256"}]},"ts":"1689984407256"} 2023-07-22 00:06:47,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407256"}]},"ts":"1689984407256"} 2023-07-22 00:06:47,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:06:47,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:47,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984407259"}]},"ts":"1689984407259"} 2023-07-22 00:06:47,261 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 00:06:47,265 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:47,266 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:47,266 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:47,266 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:47,266 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:47,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, ASSIGN}] 2023-07-22 00:06:47,269 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, ASSIGN 2023-07-22 00:06:47,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, ASSIGN 2023-07-22 00:06:47,270 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:06:47,270 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:06:47,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,420 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:06:47,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a6450684bf64c08b858966cf31040888, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,422 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=63173618d5dfe0f03cab1a26c8ecd2f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407422"}]},"ts":"1689984407422"} 2023-07-22 00:06:47,422 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407422"}]},"ts":"1689984407422"} 2023-07-22 00:06:47,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure a6450684bf64c08b858966cf31040888, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:06:47,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 63173618d5dfe0f03cab1a26c8ecd2f4, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:06:47,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,578 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,579 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:47,583 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:47,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6450684bf64c08b858966cf31040888, NAME => 'testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:06:47,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. service=AccessControlService 2023-07-22 00:06:47,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:47,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,591 INFO [StoreOpener-a6450684bf64c08b858966cf31040888-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63173618d5dfe0f03cab1a26c8ecd2f4, NAME => 'testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:06:47,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. service=AccessControlService 2023-07-22 00:06:47,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:47,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,593 DEBUG [StoreOpener-a6450684bf64c08b858966cf31040888-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf 2023-07-22 00:06:47,593 DEBUG [StoreOpener-a6450684bf64c08b858966cf31040888-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf 2023-07-22 00:06:47,594 INFO [StoreOpener-a6450684bf64c08b858966cf31040888-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6450684bf64c08b858966cf31040888 columnFamilyName cf 2023-07-22 00:06:47,595 INFO [StoreOpener-63173618d5dfe0f03cab1a26c8ecd2f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,596 INFO [StoreOpener-a6450684bf64c08b858966cf31040888-1] regionserver.HStore(310): Store=a6450684bf64c08b858966cf31040888/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:47,597 DEBUG [StoreOpener-63173618d5dfe0f03cab1a26c8ecd2f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf 2023-07-22 00:06:47,597 DEBUG [StoreOpener-63173618d5dfe0f03cab1a26c8ecd2f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf 2023-07-22 00:06:47,598 INFO [StoreOpener-63173618d5dfe0f03cab1a26c8ecd2f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63173618d5dfe0f03cab1a26c8ecd2f4 columnFamilyName cf 2023-07-22 00:06:47,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,599 INFO [StoreOpener-63173618d5dfe0f03cab1a26c8ecd2f4-1] regionserver.HStore(310): Store=63173618d5dfe0f03cab1a26c8ecd2f4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:47,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a6450684bf64c08b858966cf31040888 2023-07-22 00:06:47,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:47,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:06:47,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a6450684bf64c08b858966cf31040888; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63864393, jitterRate=-0.0483463853597641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:47,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a6450684bf64c08b858966cf31040888: 2023-07-22 00:06:47,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888., pid=30, masterSystemTime=1689984407578 2023-07-22 00:06:47,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:47,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63173618d5dfe0f03cab1a26c8ecd2f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71250551, jitterRate=0.06171594560146332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:47,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63173618d5dfe0f03cab1a26c8ecd2f4: 2023-07-22 00:06:47,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4., pid=31, masterSystemTime=1689984407578 2023-07-22 00:06:47,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,615 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a6450684bf64c08b858966cf31040888, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,615 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984407615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984407615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984407615"}]},"ts":"1689984407615"} 2023-07-22 00:06:47,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=63173618d5dfe0f03cab1a26c8ecd2f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,623 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984407619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984407619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984407619"}]},"ts":"1689984407619"} 2023-07-22 00:06:47,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-22 00:06:47,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure a6450684bf64c08b858966cf31040888, server=jenkins-hbase4.apache.org,37101,1689984379582 in 194 msec 2023-07-22 00:06:47,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, ASSIGN in 360 msec 2023-07-22 00:06:47,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-22 00:06:47,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 63173618d5dfe0f03cab1a26c8ecd2f4, server=jenkins-hbase4.apache.org,45387,1689984379695 in 201 msec 2023-07-22 00:06:47,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-22 00:06:47,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, ASSIGN in 363 msec 2023-07-22 00:06:47,632 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:47,632 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984407632"}]},"ts":"1689984407632"} 2023-07-22 00:06:47,634 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 00:06:47,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:47,637 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 00:06:47,639 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:47,641 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,641 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,641 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,641 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:47,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:47,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:47,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:47,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-07-22 00:06:47,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,805 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 00:06:47,808 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 00:06:47,808 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,810 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:47,821 DEBUG [hconnection-0x789af62c-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:47,827 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:47,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984407837 (current time:1689984407837). 2023-07-22 00:06:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x4bf7ce3e to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:47,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bcbb642, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:47,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:47,853 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:47,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bf7ce3e to 127.0.0.1:55465 2023-07-22 00:06:47,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:47,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x3305670c to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:47,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4676d96c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:47,864 DEBUG [hconnection-0x10591e46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:47,867 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:47,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:47,872 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3305670c to 127.0.0.1:55465 2023-07-22 00:06:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:47,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:47,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:47,879 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:47,880 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985007880 2023-07-22 00:06:47,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:47,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 00:06:47,881 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:47,881 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:47,883 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:47,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:47,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-22 00:06:47,885 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:47,886 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985007886 2023-07-22 00:06:47,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,911 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 00:06:47,911 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:47,913 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 00:06:47,913 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:06:47,913 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,914 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,916 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,916 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,916 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,916 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,917 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,917 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,918 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:47,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:47,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:47,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:47,919 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:47,921 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:47,922 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:47,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:47,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:47,924 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:47,930 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:47,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:47,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:47,935 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:06:47,935 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,937 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:47,937 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,937 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,937 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:47,938 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. started... 2023-07-22 00:06:47,937 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,938 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. started... 2023-07-22 00:06:47,938 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63173618d5dfe0f03cab1a26c8ecd2f4: 2023-07-22 00:06:47,939 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6450684bf64c08b858966cf31040888: 2023-07-22 00:06:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:47,939 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:47,939 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:47,939 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,940 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:47,940 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:47,941 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:47,941 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:47,958 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. completed. 2023-07-22 00:06:47,958 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:06:47,961 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. completed. 2023-07-22 00:06:47,961 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:06:47,962 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:47,962 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,962 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,962 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:47,965 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,965 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:47,965 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:47,965 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:06:47,975 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 00:06:47,975 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:47,976 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:47,976 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,976 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:47,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:47,978 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:47,979 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,982 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:47,983 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,984 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:47,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:47,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:47,989 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:47,992 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,992 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:47,993 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,997 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:47,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:47,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:47,997 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:47,999 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,000 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:47,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 00:06:48,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:06:48,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:06:48,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 00:06:48,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,081 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689984407880Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689984408014 (+134 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689984408014Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689984408014Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689984408019 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689984408031 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689984408080 (+49 ms) 2023-07-22 00:06:48,084 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 203 msec 2023-07-22 00:06:48,184 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:48,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:48,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:48,195 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 00:06:48,195 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:48,195 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:48,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984408207 (current time:1689984408207). 2023-07-22 00:06:48,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:48,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x51588d13 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29c7f438, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,218 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51588d13 to 127.0.0.1:55465 2023-07-22 00:06:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x314dac25 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e88f0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,228 DEBUG [hconnection-0x3298c99b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,229 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,235 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x314dac25 to 127.0.0.1:55465 2023-07-22 00:06:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:48,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:48,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,242 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,243 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985008243 2023-07-22 00:06:48,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 00:06:48,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,244 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:48,244 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:48,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,245 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 00:06:48,248 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,249 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985008249 2023-07-22 00:06:48,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 00:06:48,274 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 00:06:48,274 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,276 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 00:06:48,276 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:06:48,277 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,277 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,279 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,279 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,279 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,280 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,280 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,285 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,285 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,289 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,289 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,291 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,291 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,301 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,305 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:48,313 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:06:48,313 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,315 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,315 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:48,315 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,316 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. started... 2023-07-22 00:06:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,316 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,316 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 63173618d5dfe0f03cab1a26c8ecd2f4 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 00:06:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,316 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. started... 2023-07-22 00:06:48,316 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,316 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,316 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:06:48,316 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a6450684bf64c08b858966cf31040888 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 00:06:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,345 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:48,347 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:48,376 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f 2023-07-22 00:06:48,393 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55 2023-07-22 00:06:48,450 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/.tmp/cf/fe13383968d644ebbcb582c428d6bc07 2023-07-22 00:06:48,463 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/.tmp/cf/fe13383968d644ebbcb582c428d6bc07 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07 2023-07-22 00:06:48,471 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07, entries=3, sequenceid=6, filesize=5.4 K 2023-07-22 00:06:48,472 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 63173618d5dfe0f03cab1a26c8ecd2f4 in 156ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:48,472 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 00:06:48,473 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63173618d5dfe0f03cab1a26c8ecd2f4: 2023-07-22 00:06:48,473 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,473 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,474 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07] hfiles 2023-07-22 00:06:48,474 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,498 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. completed. 2023-07-22 00:06:48,498 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:06:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:06:48,504 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,504 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,504 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,505 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:06:48,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:06:48,547 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:48,549 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:06:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:48,851 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:06:48,861 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/.tmp/cf/b93f5a309bc5470ab1df5406f835b8b7 2023-07-22 00:06:48,869 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/.tmp/cf/b93f5a309bc5470ab1df5406f835b8b7 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7 2023-07-22 00:06:48,875 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7, entries=47, sequenceid=6, filesize=12.8 K 2023-07-22 00:06:48,877 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a6450684bf64c08b858966cf31040888 in 560ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:48,878 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6450684bf64c08b858966cf31040888: 2023-07-22 00:06:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7] hfiles 2023-07-22 00:06:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,900 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. completed. 2023-07-22 00:06:48,900 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:06:48,900 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,900 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,900 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,900 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,900 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:06:48,902 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,902 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,902 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,902 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:06:48,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:06:48,908 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 00:06:48,908 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:48,908 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:48,908 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,908 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,910 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,915 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,916 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,916 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,919 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,919 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,920 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:06:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,925 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 00:06:48,925 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,929 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:06:48,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:06:48,929 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:06:48,929 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,929 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f] mob files 2023-07-22 00:06:48,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55 2023-07-22 00:06:48,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f 2023-07-22 00:06:48,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 00:06:48,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 00:06:48,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,987 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689984408243Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689984408940 (+697 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689984408940Loading Region manifests for snaptb0-testExportFileSystemState at 1689984408940Writing data manifest for snaptb0-testExportFileSystemState at 1689984408944 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689984408954 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689984408986 (+32 ms) 2023-07-22 00:06:48,989 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 745 msec 2023-07-22 00:06:49,351 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:49,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:49,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:49,353 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353 2023-07-22 00:06:49,353 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35929, tgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353, rawTgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:49,381 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:06:49,381 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1257977238_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:49,382 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 00:06:49,407 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:49,839 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,840 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,840 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,840 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,841 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,841 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,841 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,911 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-8711634949650623300.jar 2023-07-22 00:06:49,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,914 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:06:49,914 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:06:49,915 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:06:49,915 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:06:49,916 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:06:49,916 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:06:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:06:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:06:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:06:49,918 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:06:49,918 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:50,746 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:06:50,749 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 00:06:50,751 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-22 00:06:51,672 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:51,673 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:51,678 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:52,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:52,634 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0002_000001 (auth:SIMPLE) 2023-07-22 00:06:57,544 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0002_000001 (auth:SIMPLE) 2023-07-22 00:06:59,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:02,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:03,965 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:03,966 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:03,975 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 00:07:03,975 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:03,976 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:03,976 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:07:03,976 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 00:07:03,976 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 00:07:03,976 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:07:03,977 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 00:07:03,977 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984409353/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 00:07:03,983 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 00:07:03,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 00:07:03,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:03,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:03,989 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984423989"}]},"ts":"1689984423989"} 2023-07-22 00:07:03,990 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 00:07:03,992 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 00:07:03,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, UNASSIGN}] 2023-07-22 00:07:03,995 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, UNASSIGN 2023-07-22 00:07:03,995 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, UNASSIGN 2023-07-22 00:07:03,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a6450684bf64c08b858966cf31040888, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:03,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984423995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984423995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984423995"}]},"ts":"1689984423995"} 2023-07-22 00:07:03,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=63173618d5dfe0f03cab1a26c8ecd2f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:03,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984423996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984423996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984423996"}]},"ts":"1689984423996"} 2023-07-22 00:07:03,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure a6450684bf64c08b858966cf31040888, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:03,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 63173618d5dfe0f03cab1a26c8ecd2f4, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:04,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a6450684bf64c08b858966cf31040888 2023-07-22 00:07:04,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a6450684bf64c08b858966cf31040888, disabling compactions & flushes 2023-07-22 00:07:04,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:07:04,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:07:04,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. after waiting 0 ms 2023-07-22 00:07:04,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:07:04,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:07:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63173618d5dfe0f03cab1a26c8ecd2f4, disabling compactions & flushes 2023-07-22 00:07:04,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:07:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:07:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. after waiting 0 ms 2023-07-22 00:07:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:07:04,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:04,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:04,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:04,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:04,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4. 2023-07-22 00:07:04,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888. 2023-07-22 00:07:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63173618d5dfe0f03cab1a26c8ecd2f4: 2023-07-22 00:07:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a6450684bf64c08b858966cf31040888: 2023-07-22 00:07:04,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a6450684bf64c08b858966cf31040888 2023-07-22 00:07:04,171 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a6450684bf64c08b858966cf31040888, regionState=CLOSED 2023-07-22 00:07:04,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:07:04,171 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984424171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424171"}]},"ts":"1689984424171"} 2023-07-22 00:07:04,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=63173618d5dfe0f03cab1a26c8ecd2f4, regionState=CLOSED 2023-07-22 00:07:04,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984424171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424171"}]},"ts":"1689984424171"} 2023-07-22 00:07:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-22 00:07:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure a6450684bf64c08b858966cf31040888, server=jenkins-hbase4.apache.org,37101,1689984379582 in 176 msec 2023-07-22 00:07:04,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-22 00:07:04,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 63173618d5dfe0f03cab1a26c8ecd2f4, server=jenkins-hbase4.apache.org,45387,1689984379695 in 176 msec 2023-07-22 00:07:04,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a6450684bf64c08b858966cf31040888, UNASSIGN in 184 msec 2023-07-22 00:07:04,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-22 00:07:04,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=63173618d5dfe0f03cab1a26c8ecd2f4, UNASSIGN in 184 msec 2023-07-22 00:07:04,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424180"}]},"ts":"1689984424180"} 2023-07-22 00:07:04,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 00:07:04,183 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 00:07:04,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-22 00:07:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:04,291 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 00:07:04,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 00:07:04,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,296 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 00:07:04,297 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,298 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 00:07:04,302 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,302 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,302 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,302 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:07:04,302 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,302 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:07:04,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,304 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,305 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/recovered.edits] 2023-07-22 00:07:04,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 00:07:04,307 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/recovered.edits] 2023-07-22 00:07:04,309 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/cf/fe13383968d644ebbcb582c428d6bc07 2023-07-22 00:07:04,312 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/cf/b93f5a309bc5470ab1df5406f835b8b7 2023-07-22 00:07:04,313 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4/recovered.edits/9.seqid 2023-07-22 00:07:04,314 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/63173618d5dfe0f03cab1a26c8ecd2f4 2023-07-22 00:07:04,315 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888/recovered.edits/9.seqid 2023-07-22 00:07:04,316 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemState/a6450684bf64c08b858966cf31040888 2023-07-22 00:07:04,316 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 00:07:04,317 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 00:07:04,317 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-22 00:07:04,321 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307220fc30f8852ea4cd39a0a199f75d74a55 2023-07-22 00:07:04,324 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307221872d15b092848ceb35fb72f7ef3ba0f 2023-07-22 00:07:04,324 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 00:07:04,327 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,330 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 00:07:04,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 00:07:04,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 00:07:04,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984424337"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984424337"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,339 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:07:04,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 63173618d5dfe0f03cab1a26c8ecd2f4, NAME => 'testtb-testExportFileSystemState,,1689984407193.63173618d5dfe0f03cab1a26c8ecd2f4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a6450684bf64c08b858966cf31040888, NAME => 'testtb-testExportFileSystemState,1,1689984407193.a6450684bf64c08b858966cf31040888.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:07:04,340 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 00:07:04,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984424340"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,341 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 00:07:04,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 52 msec 2023-07-22 00:07:04,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 00:07:04,407 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 00:07:04,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 00:07:04,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 00:07:04,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 00:07:04,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 00:07:04,453 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 752) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:46198 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1484654345_1 at /127.0.0.1:46184 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:38501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1484654345_1 at /127.0.0.1:44176 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:40448 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:44196 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=332 (was 335), ProcessCount=178 (was 178), AvailableMemoryMB=7537 (was 7690) 2023-07-22 00:07:04,453 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-22 00:07:04,481 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=178, AvailableMemoryMB=7538 2023-07-22 00:07:04,481 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-22 00:07:04,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:07:04,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:04,492 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:04,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 00:07:04,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:04,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,498 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,500 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 empty. 2023-07-22 00:07:04,500 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,501 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,501 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d empty. 2023-07-22 00:07:04,502 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,502 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 00:07:04,523 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:04,525 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7eaae9de903762039780e0ffc7ef3975, NAME => 'testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:04,526 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ae0aa98adaa3523a1218108e474bd80d, NAME => 'testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:04,540 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,540 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7eaae9de903762039780e0ffc7ef3975, disabling compactions & flushes 2023-07-22 00:07:04,540 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,540 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,540 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. after waiting 0 ms 2023-07-22 00:07:04,541 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,541 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,541 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7eaae9de903762039780e0ffc7ef3975: 2023-07-22 00:07:04,551 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,552 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ae0aa98adaa3523a1218108e474bd80d, disabling compactions & flushes 2023-07-22 00:07:04,552 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,552 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,552 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. after waiting 0 ms 2023-07-22 00:07:04,552 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,552 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,552 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ae0aa98adaa3523a1218108e474bd80d: 2023-07-22 00:07:04,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:04,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424555"}]},"ts":"1689984424555"} 2023-07-22 00:07:04,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424555"}]},"ts":"1689984424555"} 2023-07-22 00:07:04,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:04,559 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:04,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424559"}]},"ts":"1689984424559"} 2023-07-22 00:07:04,561 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 00:07:04,564 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:04,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:04,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:04,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:04,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:04,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, ASSIGN}] 2023-07-22 00:07:04,569 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, ASSIGN 2023-07-22 00:07:04,569 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, ASSIGN 2023-07-22 00:07:04,570 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:07:04,570 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:07:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,720 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:04,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ae0aa98adaa3523a1218108e474bd80d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:04,723 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7eaae9de903762039780e0ffc7ef3975, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:04,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984424723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984424723"}]},"ts":"1689984424723"} 2023-07-22 00:07:04,724 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984424723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984424723"}]},"ts":"1689984424723"} 2023-07-22 00:07:04,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ae0aa98adaa3523a1218108e474bd80d, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:04,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 7eaae9de903762039780e0ffc7ef3975, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae0aa98adaa3523a1218108e474bd80d, NAME => 'testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:07:04,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. service=AccessControlService 2023-07-22 00:07:04,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:04,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eaae9de903762039780e0ffc7ef3975, NAME => 'testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:07:04,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. service=AccessControlService 2023-07-22 00:07:04,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:04,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,886 INFO [StoreOpener-ae0aa98adaa3523a1218108e474bd80d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,888 INFO [StoreOpener-7eaae9de903762039780e0ffc7ef3975-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,889 DEBUG [StoreOpener-ae0aa98adaa3523a1218108e474bd80d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf 2023-07-22 00:07:04,889 DEBUG [StoreOpener-ae0aa98adaa3523a1218108e474bd80d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf 2023-07-22 00:07:04,890 INFO [StoreOpener-ae0aa98adaa3523a1218108e474bd80d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae0aa98adaa3523a1218108e474bd80d columnFamilyName cf 2023-07-22 00:07:04,891 DEBUG [StoreOpener-7eaae9de903762039780e0ffc7ef3975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf 2023-07-22 00:07:04,892 DEBUG [StoreOpener-7eaae9de903762039780e0ffc7ef3975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf 2023-07-22 00:07:04,892 INFO [StoreOpener-7eaae9de903762039780e0ffc7ef3975-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eaae9de903762039780e0ffc7ef3975 columnFamilyName cf 2023-07-22 00:07:04,893 INFO [StoreOpener-ae0aa98adaa3523a1218108e474bd80d-1] regionserver.HStore(310): Store=ae0aa98adaa3523a1218108e474bd80d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:04,894 INFO [StoreOpener-7eaae9de903762039780e0ffc7ef3975-1] regionserver.HStore(310): Store=7eaae9de903762039780e0ffc7ef3975/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:04,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:04,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:04,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:04,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:04,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7eaae9de903762039780e0ffc7ef3975; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71494357, jitterRate=0.06534893810749054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:04,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7eaae9de903762039780e0ffc7ef3975: 2023-07-22 00:07:04,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae0aa98adaa3523a1218108e474bd80d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62391421, jitterRate=-0.07029537856578827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:04,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae0aa98adaa3523a1218108e474bd80d: 2023-07-22 00:07:04,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975., pid=46, masterSystemTime=1689984424880 2023-07-22 00:07:04,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d., pid=45, masterSystemTime=1689984424878 2023-07-22 00:07:04,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:04,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:04,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ae0aa98adaa3523a1218108e474bd80d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:04,911 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984424911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984424911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984424911"}]},"ts":"1689984424911"} 2023-07-22 00:07:04,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7eaae9de903762039780e0ffc7ef3975, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:04,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424910"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984424910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984424910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984424910"}]},"ts":"1689984424910"} 2023-07-22 00:07:04,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 00:07:04,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ae0aa98adaa3523a1218108e474bd80d, server=jenkins-hbase4.apache.org,37101,1689984379582 in 187 msec 2023-07-22 00:07:04,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 00:07:04,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 7eaae9de903762039780e0ffc7ef3975, server=jenkins-hbase4.apache.org,45387,1689984379695 in 189 msec 2023-07-22 00:07:04,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, ASSIGN in 352 msec 2023-07-22 00:07:04,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-22 00:07:04,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, ASSIGN in 353 msec 2023-07-22 00:07:04,922 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:04,922 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424922"}]},"ts":"1689984424922"} 2023-07-22 00:07:04,923 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 00:07:04,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:04,927 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 00:07:04,929 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:04,931 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,931 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,931 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,931 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 448 msec 2023-07-22 00:07:05,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:05,099 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 00:07:05,101 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 00:07:05,102 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,104 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:05,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984425117 (current time:1689984425117). 2023-07-22 00:07:05,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:05,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x5da723cd to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e941b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,136 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5da723cd to 127.0.0.1:55465 2023-07-22 00:07:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x2b05819d to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75d8e220, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,149 DEBUG [hconnection-0x7eb7d1f1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,153 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,163 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b05819d to 127.0.0.1:55465 2023-07-22 00:07:05,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,172 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,173 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689985025173 2023-07-22 00:07:05,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 00:07:05,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,176 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:05,176 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:05,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,178 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-22 00:07:05,184 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,185 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689985025185 2023-07-22 00:07:05,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,203 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 00:07:05,203 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,205 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 00:07:05,205 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 00:07:05,205 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,206 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,207 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,207 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,208 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,208 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,208 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,208 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,209 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,210 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,210 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,210 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,210 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,210 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,210 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,214 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,220 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,220 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,221 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,221 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,221 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,221 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,221 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,221 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:05,231 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 00:07:05,231 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,233 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,233 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,234 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,234 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,234 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:05,234 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. started... 2023-07-22 00:07:05,234 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,234 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,234 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. started... 2023-07-22 00:07:05,235 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,235 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,235 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae9de903762039780e0ffc7ef3975: 2023-07-22 00:07:05,235 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,240 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:05,235 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:07:05,240 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,240 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae0aa98adaa3523a1218108e474bd80d: 2023-07-22 00:07:05,242 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,242 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:05,243 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,244 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,244 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:05,248 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,248 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,248 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,276 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:05,279 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:05,279 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. completed. 2023-07-22 00:07:05,279 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. completed. 2023-07-22 00:07:05,280 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,279 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:07:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:07:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,282 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,282 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,282 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,284 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:07:05,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 00:07:05,292 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 00:07:05,292 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:05,292 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:05,292 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,292 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,294 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,295 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,299 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,299 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,301 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,301 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,302 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,305 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,307 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,306 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 00:07:05,305 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,307 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:07:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,308 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,308 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,308 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,308 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:07:05,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 00:07:05,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,364 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689984425173Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689984425316 (+143 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689984425316Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689984425317 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689984425321 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689984425330 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689984425364 (+34 ms) 2023-07-22 00:07:05,367 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 192 msec 2023-07-22 00:07:05,479 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:05,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:05,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 00:07:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,492 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:05,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984425505 (current time:1689984425505). 2023-07-22 00:07:05,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:05,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x54833323 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73369601, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,524 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54833323 to 127.0.0.1:55465 2023-07-22 00:07:05,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x7007c439 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dd0eb31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,637 DEBUG [hconnection-0x7a91f414-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,640 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,647 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7007c439 to 127.0.0.1:55465 2023-07-22 00:07:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:05,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:05,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,653 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,653 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689985025653 2023-07-22 00:07:05,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 00:07:05,655 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:05,655 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:05,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,659 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-22 00:07:05,662 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,663 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689985025662 2023-07-22 00:07:05,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 00:07:05,690 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 00:07:05,690 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,692 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 00:07:05,692 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 00:07:05,692 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,692 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,695 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,695 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,695 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,696 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,697 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,703 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,704 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,704 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70640865[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70640865[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:05,709 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 00:07:05,709 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,710 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:07:05,711 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,712 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,711 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:05,711 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,712 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. started... 2023-07-22 00:07:05,712 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:05,712 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,712 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. started... 2023-07-22 00:07:05,712 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ae0aa98adaa3523a1218108e474bd80d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 00:07:05,712 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7eaae9de903762039780e0ffc7ef3975 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 00:07:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,715 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,751 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44 2023-07-22 00:07:05,755 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,756 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b 2023-07-22 00:07:05,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:05,757 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:05,762 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/.tmp/cf/2b81faeeb22948c2aa1580f1f16b7ad3 2023-07-22 00:07:05,767 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/.tmp/cf/559dde7dc74d4b2eaa6916fffb8c91af 2023-07-22 00:07:05,768 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/.tmp/cf/2b81faeeb22948c2aa1580f1f16b7ad3 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3 2023-07-22 00:07:05,772 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/.tmp/cf/559dde7dc74d4b2eaa6916fffb8c91af as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af 2023-07-22 00:07:05,773 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3, entries=47, sequenceid=6, filesize=12.7 K 2023-07-22 00:07:05,774 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ae0aa98adaa3523a1218108e474bd80d in 62ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:05,774 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 00:07:05,775 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae0aa98adaa3523a1218108e474bd80d: 2023-07-22 00:07:05,776 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,776 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,776 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3] hfiles 2023-07-22 00:07:05,776 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,778 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af, entries=3, sequenceid=6, filesize=5.4 K 2023-07-22 00:07:05,779 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7eaae9de903762039780e0ffc7ef3975 in 67ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:05,781 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae9de903762039780e0ffc7ef3975: 2023-07-22 00:07:05,781 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,781 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,781 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af] hfiles 2023-07-22 00:07:05,781 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,792 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. completed. 2023-07-22 00:07:05,793 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:05,793 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,793 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,793 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,793 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,793 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:07:05,795 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,795 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,795 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,795 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:07:05,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 00:07:05,806 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. completed. 2023-07-22 00:07:05,806 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:05,806 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,806 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,806 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,806 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,806 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:07:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,808 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:07:05,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 00:07:05,815 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 00:07:05,815 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:05,815 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:05,815 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,815 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,817 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,818 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,819 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,820 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,822 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,823 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,823 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,830 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,832 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,832 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,830 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 00:07:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,832 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 00:07:05,832 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:05,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:05,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,833 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b] mob files 2023-07-22 00:07:05,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44 2023-07-22 00:07:05,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b 2023-07-22 00:07:05,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 00:07:05,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 00:07:05,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,906 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689984425654Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689984425850 (+196 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689984425850Loading Region manifests for snaptb0-testConsecutiveExports at 1689984425850Writing data manifest for snaptb0-testConsecutiveExports at 1689984425854 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689984425875 (+21 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689984425906 (+31 ms) 2023-07-22 00:07:05,909 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 254 msec 2023-07-22 00:07:05,957 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:05,959 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958 2023-07-22 00:07:05,959 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:05,984 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:05,984 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@55b05276, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,984 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 00:07:06,004 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:06,021 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,021 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,022 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,022 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,023 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,023 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,024 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,108 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-1261670013734253419.jar 2023-07-22 00:07:06,109 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,109 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,110 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,111 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:06,111 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:06,112 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:06,112 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:06,113 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:06,113 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:06,118 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:06,118 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:06,639 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:06,642 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 00:07:06,645 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 00:07:09,050 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:09,050 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:09,053 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:09,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:09,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:07:14,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:16,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:19,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:20,851 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:20,851 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:20,856 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 00:07:20,856 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:20,857 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:20,857 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,857 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:20,858 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:20,858 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59870bf1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,858 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:20,858 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:20,859 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:20,881 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:20,881 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4adaa576, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,881 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 00:07:20,896 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,912 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,913 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,914 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,995 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-7028408402929533948.jar 2023-07-22 00:07:20,995 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,996 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,997 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,997 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,997 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,998 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,998 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:20,999 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:20,999 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:21,001 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:21,001 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:21,005 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:21,005 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:21,006 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:21,805 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:21,808 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 00:07:21,810 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 00:07:25,470 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:25,470 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:25,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:26,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:30,872 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:33,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:36,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:38,170 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:38,171 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:38,174 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 00:07:38,175 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:38,175 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:38,175 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:38,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59870bf1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:38,182 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/local-export-1689984425958/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:38,197 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 00:07:38,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 00:07:38,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,211 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984458210"}]},"ts":"1689984458210"} 2023-07-22 00:07:38,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:38,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 00:07:38,218 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 00:07:38,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, UNASSIGN}] 2023-07-22 00:07:38,221 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, UNASSIGN 2023-07-22 00:07:38,221 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, UNASSIGN 2023-07-22 00:07:38,222 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7eaae9de903762039780e0ffc7ef3975, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:38,222 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ae0aa98adaa3523a1218108e474bd80d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:38,223 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984458222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984458222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984458222"}]},"ts":"1689984458222"} 2023-07-22 00:07:38,223 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984458222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984458222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984458222"}]},"ts":"1689984458222"} 2023-07-22 00:07:38,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ae0aa98adaa3523a1218108e474bd80d, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:38,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 7eaae9de903762039780e0ffc7ef3975, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:38,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:38,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:38,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae0aa98adaa3523a1218108e474bd80d, disabling compactions & flushes 2023-07-22 00:07:38,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:38,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:38,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. after waiting 0 ms 2023-07-22 00:07:38,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:38,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:38,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7eaae9de903762039780e0ffc7ef3975, disabling compactions & flushes 2023-07-22 00:07:38,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:38,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:38,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. after waiting 0 ms 2023-07-22 00:07:38,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:38,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:38,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:38,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d. 2023-07-22 00:07:38,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae0aa98adaa3523a1218108e474bd80d: 2023-07-22 00:07:38,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:38,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:38,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ae0aa98adaa3523a1218108e474bd80d, regionState=CLOSED 2023-07-22 00:07:38,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984458400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984458400"}]},"ts":"1689984458400"} 2023-07-22 00:07:38,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:38,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975. 2023-07-22 00:07:38,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7eaae9de903762039780e0ffc7ef3975: 2023-07-22 00:07:38,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:38,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7eaae9de903762039780e0ffc7ef3975, regionState=CLOSED 2023-07-22 00:07:38,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984458407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984458407"}]},"ts":"1689984458407"} 2023-07-22 00:07:38,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-22 00:07:38,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ae0aa98adaa3523a1218108e474bd80d, server=jenkins-hbase4.apache.org,37101,1689984379582 in 178 msec 2023-07-22 00:07:38,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ae0aa98adaa3523a1218108e474bd80d, UNASSIGN in 190 msec 2023-07-22 00:07:38,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-22 00:07:38,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 7eaae9de903762039780e0ffc7ef3975, server=jenkins-hbase4.apache.org,45387,1689984379695 in 183 msec 2023-07-22 00:07:38,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-22 00:07:38,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7eaae9de903762039780e0ffc7ef3975, UNASSIGN in 192 msec 2023-07-22 00:07:38,414 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984458414"}]},"ts":"1689984458414"} 2023-07-22 00:07:38,415 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 00:07:38,418 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 00:07:38,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 220 msec 2023-07-22 00:07:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:38,516 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 00:07:38,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 00:07:38,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 00:07:38,527 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,531 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 00:07:38,535 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,536 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,536 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,535 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:38,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:38,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:38,537 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:38,538 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,538 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,538 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,538 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,539 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,539 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:38,539 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,539 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 00:07:38,542 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/recovered.edits] 2023-07-22 00:07:38,543 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:38,548 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/recovered.edits] 2023-07-22 00:07:38,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/cf/559dde7dc74d4b2eaa6916fffb8c91af 2023-07-22 00:07:38,557 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/cf/2b81faeeb22948c2aa1580f1f16b7ad3 2023-07-22 00:07:38,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975/recovered.edits/9.seqid 2023-07-22 00:07:38,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/7eaae9de903762039780e0ffc7ef3975 2023-07-22 00:07:38,570 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d/recovered.edits/9.seqid 2023-07-22 00:07:38,572 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testConsecutiveExports/ae0aa98adaa3523a1218108e474bd80d 2023-07-22 00:07:38,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 00:07:38,573 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 00:07:38,573 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-22 00:07:38,579 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307228ae50098e43b44f6ae25853c82fbac44 2023-07-22 00:07:38,581 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307224c61d9978707455ab25669c1e4dbdf0b 2023-07-22 00:07:38,581 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 00:07:38,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,596 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 00:07:38,600 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 00:07:38,602 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,602 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 00:07:38,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984458602"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:38,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984458602"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:38,619 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:07:38,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7eaae9de903762039780e0ffc7ef3975, NAME => 'testtb-testConsecutiveExports,,1689984424483.7eaae9de903762039780e0ffc7ef3975.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ae0aa98adaa3523a1218108e474bd80d, NAME => 'testtb-testConsecutiveExports,1,1689984424483.ae0aa98adaa3523a1218108e474bd80d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:07:38,620 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 00:07:38,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984458620"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:38,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 00:07:38,636 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 00:07:38,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 119 msec 2023-07-22 00:07:38,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 00:07:38,844 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 00:07:38,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 00:07:38,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:38,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 00:07:38,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 00:07:38,944 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 765), OpenFileDescriptor=895 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=538 (was 332) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=7429 (was 7538) 2023-07-22 00:07:38,945 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-22 00:07:38,973 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=538, ProcessCount=180, AvailableMemoryMB=7426 2023-07-22 00:07:38,973 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-22 00:07:38,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:07:38,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,982 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:38,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 00:07:38,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:38,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:38,991 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:38,991 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:38,991 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 empty. 2023-07-22 00:07:38,991 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f empty. 2023-07-22 00:07:38,992 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:38,992 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:38,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 00:07:39,021 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:39,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => b61e62d5695ac4edbd83721d82cd5579, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:39,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 07f4dc4362324d9fcce0bf4aa302b64f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:39,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:39,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing b61e62d5695ac4edbd83721d82cd5579, disabling compactions & flushes 2023-07-22 00:07:39,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. after waiting 0 ms 2023-07-22 00:07:39,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for b61e62d5695ac4edbd83721d82cd5579: 2023-07-22 00:07:39,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 07f4dc4362324d9fcce0bf4aa302b64f, disabling compactions & flushes 2023-07-22 00:07:39,095 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. after waiting 0 ms 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,095 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 07f4dc4362324d9fcce0bf4aa302b64f: 2023-07-22 00:07:39,098 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:39,100 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984459100"}]},"ts":"1689984459100"} 2023-07-22 00:07:39,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984459100"}]},"ts":"1689984459100"} 2023-07-22 00:07:39,114 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:39,119 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:39,119 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984459119"}]},"ts":"1689984459119"} 2023-07-22 00:07:39,121 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 00:07:39,125 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:39,126 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:39,126 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:39,126 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:39,126 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:39,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, ASSIGN}] 2023-07-22 00:07:39,129 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, ASSIGN 2023-07-22 00:07:39,130 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, ASSIGN 2023-07-22 00:07:39,131 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:07:39,131 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:07:39,281 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:39,287 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b61e62d5695ac4edbd83721d82cd5579, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,287 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=07f4dc4362324d9fcce0bf4aa302b64f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984459287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984459287"}]},"ts":"1689984459287"} 2023-07-22 00:07:39,288 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984459287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984459287"}]},"ts":"1689984459287"} 2023-07-22 00:07:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:39,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure b61e62d5695ac4edbd83721d82cd5579, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:39,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 07f4dc4362324d9fcce0bf4aa302b64f, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:39,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b61e62d5695ac4edbd83721d82cd5579, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:07:39,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. service=AccessControlService 2023-07-22 00:07:39,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:39,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07f4dc4362324d9fcce0bf4aa302b64f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. service=AccessControlService 2023-07-22 00:07:39,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,464 INFO [StoreOpener-b61e62d5695ac4edbd83721d82cd5579-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,465 INFO [StoreOpener-07f4dc4362324d9fcce0bf4aa302b64f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,466 DEBUG [StoreOpener-b61e62d5695ac4edbd83721d82cd5579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf 2023-07-22 00:07:39,466 DEBUG [StoreOpener-b61e62d5695ac4edbd83721d82cd5579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf 2023-07-22 00:07:39,466 DEBUG [StoreOpener-07f4dc4362324d9fcce0bf4aa302b64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf 2023-07-22 00:07:39,467 DEBUG [StoreOpener-07f4dc4362324d9fcce0bf4aa302b64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf 2023-07-22 00:07:39,467 INFO [StoreOpener-b61e62d5695ac4edbd83721d82cd5579-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b61e62d5695ac4edbd83721d82cd5579 columnFamilyName cf 2023-07-22 00:07:39,469 INFO [StoreOpener-b61e62d5695ac4edbd83721d82cd5579-1] regionserver.HStore(310): Store=b61e62d5695ac4edbd83721d82cd5579/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:39,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:07:39,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:39,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b61e62d5695ac4edbd83721d82cd5579; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69390223, jitterRate=0.033994898200035095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:39,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b61e62d5695ac4edbd83721d82cd5579: 2023-07-22 00:07:39,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579., pid=60, masterSystemTime=1689984459457 2023-07-22 00:07:39,479 INFO [StoreOpener-07f4dc4362324d9fcce0bf4aa302b64f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07f4dc4362324d9fcce0bf4aa302b64f columnFamilyName cf 2023-07-22 00:07:39,481 INFO [StoreOpener-07f4dc4362324d9fcce0bf4aa302b64f-1] regionserver.HStore(310): Store=07f4dc4362324d9fcce0bf4aa302b64f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,483 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b61e62d5695ac4edbd83721d82cd5579, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,483 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984459483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984459483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984459483"}]},"ts":"1689984459483"} 2023-07-22 00:07:39,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:07:39,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-22 00:07:39,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure b61e62d5695ac4edbd83721d82cd5579, server=jenkins-hbase4.apache.org,45387,1689984379695 in 190 msec 2023-07-22 00:07:39,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, ASSIGN in 361 msec 2023-07-22 00:07:39,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:39,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07f4dc4362324d9fcce0bf4aa302b64f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68521937, jitterRate=0.02105642855167389}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:39,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07f4dc4362324d9fcce0bf4aa302b64f: 2023-07-22 00:07:39,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f., pid=61, masterSystemTime=1689984459457 2023-07-22 00:07:39,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,497 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=07f4dc4362324d9fcce0bf4aa302b64f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,498 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984459497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984459497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984459497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984459497"}]},"ts":"1689984459497"} 2023-07-22 00:07:39,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-22 00:07:39,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 07f4dc4362324d9fcce0bf4aa302b64f, server=jenkins-hbase4.apache.org,37101,1689984379582 in 203 msec 2023-07-22 00:07:39,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-22 00:07:39,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, ASSIGN in 382 msec 2023-07-22 00:07:39,522 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:39,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984459522"}]},"ts":"1689984459522"} 2023-07-22 00:07:39,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 00:07:39,528 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:39,528 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 00:07:39,531 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:39,533 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:39,533 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:39,533 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:39,533 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:39,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:39,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:39,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:39,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:39,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 558 msec 2023-07-22 00:07:39,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:39,590 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 00:07:39,603 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,603 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,605 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:39,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984459660 (current time:1689984459660). 2023-07-22 00:07:39,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:39,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x795b372f to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:39,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b3ad1fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:39,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:39,679 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:39,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x795b372f to 127.0.0.1:55465 2023-07-22 00:07:39,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:39,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x2cd86142 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:39,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c1ac9b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:39,788 DEBUG [hconnection-0x113274c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:39,789 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:39,799 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cd86142 to 127.0.0.1:55465 2023-07-22 00:07:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:39,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:39,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,810 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,811 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689985059811 2023-07-22 00:07:39,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,819 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:39,819 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:39,822 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:39,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 15 msec 2023-07-22 00:07:39,825 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:39,826 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689985059826 2023-07-22 00:07:39,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,855 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:39,855 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,857 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 00:07:39,857 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 00:07:39,858 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,858 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,878 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,878 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,879 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,879 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,879 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,886 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,886 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,886 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,908 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:39,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:39,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:39,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,924 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,924 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,925 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,925 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:39,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea07f91[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:39,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea07f91[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:39,929 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 00:07:39,929 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,948 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,948 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. started... 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:39,948 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b61e62d5695ac4edbd83721d82cd5579: 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. started... 2023-07-22 00:07:39,948 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07f4dc4362324d9fcce0bf4aa302b64f: 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:39,950 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:39,969 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. completed. 2023-07-22 00:07:39,969 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:39,969 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:07:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,991 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. completed. 2023-07-22 00:07:39,991 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:07:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:40,001 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,009 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:07:40,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 00:07:40,021 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 00:07:40,021 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:40,021 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:40,021 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,021 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,024 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,025 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,025 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,033 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,034 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,034 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,056 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,056 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,055 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,055 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,056 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,058 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,059 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:07:40,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,120 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:40,122 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:07:40,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 00:07:40,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,191 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689984459811Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689984460075 (+264 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984460075Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984460076 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984460080 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984460113 (+33 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689984460190 (+77 ms) 2023-07-22 00:07:40,193 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:40,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 374 msec 2023-07-22 00:07:40,422 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:40,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:40,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:40,435 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,435 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:40,435 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:40,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984460448 (current time:1689984460448). 2023-07-22 00:07:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x0a0f49a3 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:40,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f5260c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:40,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:40,468 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a0f49a3 to 127.0.0.1:55465 2023-07-22 00:07:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:40,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x4f08184c to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:40,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3a125f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:40,491 DEBUG [hconnection-0x5382210a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:40,495 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:40,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:40,507 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f08184c to 127.0.0.1:55465 2023-07-22 00:07:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:40,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:40,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:40,516 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:40,517 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689985060517 2023-07-22 00:07:40,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:40,518 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:40,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:40,520 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:40,519 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:40,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-22 00:07:40,529 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:40,531 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689985060531 2023-07-22 00:07:40,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,556 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:40,556 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:40,558 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 00:07:40,558 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 00:07:40,558 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:40,558 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,558 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,560 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,560 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,560 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,560 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,561 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,561 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,562 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,562 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:40,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:40,565 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,572 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,572 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,573 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,573 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:40,573 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,573 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:40,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:40,580 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 00:07:40,580 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:40,582 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:07:40,582 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. started... 2023-07-22 00:07:40,582 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b61e62d5695ac4edbd83721d82cd5579 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:40,582 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:40,583 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:40,583 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. started... 2023-07-22 00:07:40,583 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07f4dc4362324d9fcce0bf4aa302b64f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 00:07:40,593 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,594 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,594 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:40,620 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:40,622 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:40,630 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e 2023-07-22 00:07:40,643 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8 2023-07-22 00:07:40,657 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/.tmp/cf/045a9c3a9b95478bae4f92b355b0811a 2023-07-22 00:07:40,663 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/.tmp/cf/045a9c3a9b95478bae4f92b355b0811a as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a 2023-07-22 00:07:40,667 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a, entries=5, sequenceid=6, filesize=5.8 K 2023-07-22 00:07:40,668 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b61e62d5695ac4edbd83721d82cd5579 in 86ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:40,670 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b61e62d5695ac4edbd83721d82cd5579: 2023-07-22 00:07:40,670 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,670 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:40,670 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a] hfiles 2023-07-22 00:07:40,670 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,679 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. completed. 2023-07-22 00:07:40,679 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:07:40,679 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:40,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:40,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:40,680 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:07:40,681 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:40,681 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,681 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,682 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:40,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:40,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:07:40,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 00:07:40,822 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:40,824 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:07:41,047 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/.tmp/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 2023-07-22 00:07:41,053 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/.tmp/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 2023-07-22 00:07:41,059 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287, entries=45, sequenceid=6, filesize=13.2 K 2023-07-22 00:07:41,060 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 07f4dc4362324d9fcce0bf4aa302b64f in 477ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:41,060 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07f4dc4362324d9fcce0bf4aa302b64f: 2023-07-22 00:07:41,060 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,060 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:41,060 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287] hfiles 2023-07-22 00:07:41,060 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,068 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. completed. 2023-07-22 00:07:41,068 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:07:41,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:41,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:41,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:41,068 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:07:41,070 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,070 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:41,070 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:41,070 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:07:41,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 00:07:41,075 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 00:07:41,075 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:41,075 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:41,075 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,075 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,082 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,082 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:41,083 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,083 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,086 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:41,087 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,087 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,090 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:41,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,090 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:07:41,092 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:41,093 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,093 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,093 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:41,093 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,093 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8] mob files 2023-07-22 00:07:41,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e 2023-07-22 00:07:41,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8 2023-07-22 00:07:41,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,124 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:41,126 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:07:41,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 00:07:41,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,157 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:41,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689984460517Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689984461102 (+585 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689984461102Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689984461102Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689984461107 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689984461119 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689984461156 (+37 ms) 2023-07-22 00:07:41,159 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:41,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 641 msec 2023-07-22 00:07:41,626 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:41,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:41,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:41,667 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:41,670 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:41,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:41,672 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:41,676 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:41,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40135] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:41,677 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:41,683 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:41,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:41,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:07:41,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:41,691 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:41,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 00:07:41,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:41,696 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:41,699 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:41,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:41,700 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 empty. 2023-07-22 00:07:41,700 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:41,703 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 empty. 2023-07-22 00:07:41,704 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:41,704 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 00:07:41,742 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:41,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b62bd75f3c82d12a790f8414d2bc520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:41,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 22d0ecf4121576fac3f2aca4e369ac10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:07:41,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:41,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2b62bd75f3c82d12a790f8414d2bc520, disabling compactions & flushes 2023-07-22 00:07:41,782 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:41,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:41,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. after waiting 0 ms 2023-07-22 00:07:41,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:41,783 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:41,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2b62bd75f3c82d12a790f8414d2bc520: 2023-07-22 00:07:41,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:41,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 22d0ecf4121576fac3f2aca4e369ac10, disabling compactions & flushes 2023-07-22 00:07:41,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:41,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:41,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. after waiting 0 ms 2023-07-22 00:07:41,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:41,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:41,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 22d0ecf4121576fac3f2aca4e369ac10: 2023-07-22 00:07:41,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:41,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984461793"}]},"ts":"1689984461793"} 2023-07-22 00:07:41,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984461793"}]},"ts":"1689984461793"} 2023-07-22 00:07:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:41,807 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:41,808 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:41,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984461808"}]},"ts":"1689984461808"} 2023-07-22 00:07:41,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 00:07:41,812 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:41,813 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:41,813 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:41,813 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:41,813 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:41,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, ASSIGN}] 2023-07-22 00:07:41,816 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, ASSIGN 2023-07-22 00:07:41,817 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, ASSIGN 2023-07-22 00:07:41,817 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:07:41,817 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:07:41,968 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:41,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=22d0ecf4121576fac3f2aca4e369ac10, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:41,970 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2b62bd75f3c82d12a790f8414d2bc520, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:41,971 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461970"}]},"ts":"1689984461970"} 2023-07-22 00:07:41,971 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461970"}]},"ts":"1689984461970"} 2023-07-22 00:07:41,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 22d0ecf4121576fac3f2aca4e369ac10, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:41,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 2b62bd75f3c82d12a790f8414d2bc520, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:42,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:42,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22d0ecf4121576fac3f2aca4e369ac10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 00:07:42,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b62bd75f3c82d12a790f8414d2bc520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. service=AccessControlService 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. service=AccessControlService 2023-07-22 00:07:42,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:42,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,130 INFO [StoreOpener-22d0ecf4121576fac3f2aca4e369ac10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,130 INFO [StoreOpener-2b62bd75f3c82d12a790f8414d2bc520-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,135 DEBUG [StoreOpener-2b62bd75f3c82d12a790f8414d2bc520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf 2023-07-22 00:07:42,135 DEBUG [StoreOpener-2b62bd75f3c82d12a790f8414d2bc520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf 2023-07-22 00:07:42,136 INFO [StoreOpener-2b62bd75f3c82d12a790f8414d2bc520-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b62bd75f3c82d12a790f8414d2bc520 columnFamilyName cf 2023-07-22 00:07:42,136 INFO [StoreOpener-2b62bd75f3c82d12a790f8414d2bc520-1] regionserver.HStore(310): Store=2b62bd75f3c82d12a790f8414d2bc520/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:42,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,138 DEBUG [StoreOpener-22d0ecf4121576fac3f2aca4e369ac10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf 2023-07-22 00:07:42,138 DEBUG [StoreOpener-22d0ecf4121576fac3f2aca4e369ac10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf 2023-07-22 00:07:42,139 INFO [StoreOpener-22d0ecf4121576fac3f2aca4e369ac10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22d0ecf4121576fac3f2aca4e369ac10 columnFamilyName cf 2023-07-22 00:07:42,140 INFO [StoreOpener-22d0ecf4121576fac3f2aca4e369ac10-1] regionserver.HStore(310): Store=22d0ecf4121576fac3f2aca4e369ac10/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:42,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b62bd75f3c82d12a790f8414d2bc520; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68046330, jitterRate=0.013969331979751587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:42,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b62bd75f3c82d12a790f8414d2bc520: 2023-07-22 00:07:42,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520., pid=70, masterSystemTime=1689984462125 2023-07-22 00:07:42,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:42,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 22d0ecf4121576fac3f2aca4e369ac10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63479075, jitterRate=-0.05408807098865509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:42,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 22d0ecf4121576fac3f2aca4e369ac10: 2023-07-22 00:07:42,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10., pid=69, masterSystemTime=1689984462124 2023-07-22 00:07:42,154 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2b62bd75f3c82d12a790f8414d2bc520, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:42,155 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984462149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984462149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984462149"}]},"ts":"1689984462149"} 2023-07-22 00:07:42,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=22d0ecf4121576fac3f2aca4e369ac10, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:42,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984462156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984462156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984462156"}]},"ts":"1689984462156"} 2023-07-22 00:07:42,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-22 00:07:42,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 2b62bd75f3c82d12a790f8414d2bc520, server=jenkins-hbase4.apache.org,45387,1689984379695 in 183 msec 2023-07-22 00:07:42,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-22 00:07:42,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 22d0ecf4121576fac3f2aca4e369ac10, server=jenkins-hbase4.apache.org,37101,1689984379582 in 186 msec 2023-07-22 00:07:42,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, ASSIGN in 347 msec 2023-07-22 00:07:42,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-22 00:07:42,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, ASSIGN in 347 msec 2023-07-22 00:07:42,165 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:42,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984462165"}]},"ts":"1689984462165"} 2023-07-22 00:07:42,168 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 00:07:42,173 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:42,173 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 00:07:42,176 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 00:07:42,177 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:42,177 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:42,177 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:42,177 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:42,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:42,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 492 msec 2023-07-22 00:07:42,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:42,304 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 00:07:42,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10], force=true 2023-07-22 00:07:42,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10], force=true 2023-07-22 00:07:42,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10], force=true 2023-07-22 00:07:42,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10], force=true 2023-07-22 00:07:42,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, UNASSIGN}] 2023-07-22 00:07:42,373 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, UNASSIGN 2023-07-22 00:07:42,373 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, UNASSIGN 2023-07-22 00:07:42,374 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2b62bd75f3c82d12a790f8414d2bc520, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:42,374 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=22d0ecf4121576fac3f2aca4e369ac10, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:42,374 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984462374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984462374"}]},"ts":"1689984462374"} 2023-07-22 00:07:42,374 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984462374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984462374"}]},"ts":"1689984462374"} 2023-07-22 00:07:42,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 2b62bd75f3c82d12a790f8414d2bc520, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:42,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 22d0ecf4121576fac3f2aca4e369ac10, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:07:42,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b62bd75f3c82d12a790f8414d2bc520, disabling compactions & flushes 2023-07-22 00:07:42,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. after waiting 0 ms 2023-07-22 00:07:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2b62bd75f3c82d12a790f8414d2bc520 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 00:07:42,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 22d0ecf4121576fac3f2aca4e369ac10, disabling compactions & flushes 2023-07-22 00:07:42,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. after waiting 0 ms 2023-07-22 00:07:42,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 22d0ecf4121576fac3f2aca4e369ac10 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 00:07:42,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/.tmp/cf/57dc403255ae4474952bc42128f3bc41 2023-07-22 00:07:42,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/.tmp/cf/abdbb222b67d4d7cb5fc42202f56f6ce 2023-07-22 00:07:42,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/.tmp/cf/57dc403255ae4474952bc42128f3bc41 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41 2023-07-22 00:07:42,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/.tmp/cf/abdbb222b67d4d7cb5fc42202f56f6ce as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce 2023-07-22 00:07:42,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 00:07:42,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 00:07:42,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2b62bd75f3c82d12a790f8414d2bc520 in 42ms, sequenceid=5, compaction requested=false 2023-07-22 00:07:42,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 00:07:42,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 22d0ecf4121576fac3f2aca4e369ac10 in 40ms, sequenceid=5, compaction requested=false 2023-07-22 00:07:42,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 00:07:42,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 00:07:42,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 00:07:42,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:42,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:42,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520. 2023-07-22 00:07:42,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b62bd75f3c82d12a790f8414d2bc520: 2023-07-22 00:07:42,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10. 2023-07-22 00:07:42,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 22d0ecf4121576fac3f2aca4e369ac10: 2023-07-22 00:07:42,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:07:42,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2b62bd75f3c82d12a790f8414d2bc520, regionState=CLOSED 2023-07-22 00:07:42,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984462589"}]},"ts":"1689984462589"} 2023-07-22 00:07:42,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:07:42,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=22d0ecf4121576fac3f2aca4e369ac10, regionState=CLOSED 2023-07-22 00:07:42,590 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984462590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984462590"}]},"ts":"1689984462590"} 2023-07-22 00:07:42,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-22 00:07:42,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 2b62bd75f3c82d12a790f8414d2bc520, server=jenkins-hbase4.apache.org,45387,1689984379695 in 215 msec 2023-07-22 00:07:42,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2b62bd75f3c82d12a790f8414d2bc520, UNASSIGN in 229 msec 2023-07-22 00:07:42,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-22 00:07:42,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 22d0ecf4121576fac3f2aca4e369ac10, server=jenkins-hbase4.apache.org,37101,1689984379582 in 219 msec 2023-07-22 00:07:42,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-22 00:07:42,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=22d0ecf4121576fac3f2aca4e369ac10, UNASSIGN in 229 msec 2023-07-22 00:07:42,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,679 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 00:07:42,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461686.2b62bd75f3c82d12a790f8414d2bc520.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984461686.22d0ecf4121576fac3f2aca4e369ac10.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,682 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, ASSIGN}] 2023-07-22 00:07:42,745 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, ASSIGN 2023-07-22 00:07:42,746 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:07:42,896 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:07:42,898 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=afb0684e821bd5a7a5aebcc40f68ea03, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:42,898 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984462898"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984462898"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984462898"}]},"ts":"1689984462898"} 2023-07-22 00:07:42,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure afb0684e821bd5a7a5aebcc40f68ea03, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:07:42,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:43,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:07:43,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => afb0684e821bd5a7a5aebcc40f68ea03, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:07:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. service=AccessControlService 2023-07-22 00:07:43,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/.regioninfo 2023-07-22 00:07:43,071 INFO [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,072 DEBUG [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf 2023-07-22 00:07:43,072 DEBUG [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf 2023-07-22 00:07:43,073 INFO [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afb0684e821bd5a7a5aebcc40f68ea03 columnFamilyName cf 2023-07-22 00:07:43,103 DEBUG [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] regionserver.HStore(539): loaded hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/57dc403255ae4474952bc42128f3bc41.2b62bd75f3c82d12a790f8414d2bc520->hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41-top 2023-07-22 00:07:43,109 DEBUG [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] regionserver.HStore(539): loaded hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/abdbb222b67d4d7cb5fc42202f56f6ce.22d0ecf4121576fac3f2aca4e369ac10->hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce-top 2023-07-22 00:07:43,109 INFO [StoreOpener-afb0684e821bd5a7a5aebcc40f68ea03-1] regionserver.HStore(310): Store=afb0684e821bd5a7a5aebcc40f68ea03/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:43,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:07:43,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened afb0684e821bd5a7a5aebcc40f68ea03; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64034336, jitterRate=-0.04581403732299805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:43,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for afb0684e821bd5a7a5aebcc40f68ea03: 2023-07-22 00:07:43,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03., pid=77, masterSystemTime=1689984463052 2023-07-22 00:07:43,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.,because compaction is disabled. 2023-07-22 00:07:43,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:07:43,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:07:43,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=afb0684e821bd5a7a5aebcc40f68ea03, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,120 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984463120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984463120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984463120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984463120"}]},"ts":"1689984463120"} 2023-07-22 00:07:43,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 00:07:43,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure afb0684e821bd5a7a5aebcc40f68ea03, server=jenkins-hbase4.apache.org,45387,1689984379695 in 223 msec 2023-07-22 00:07:43,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 00:07:43,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, ASSIGN in 385 msec 2023-07-22 00:07:43,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2b62bd75f3c82d12a790f8414d2bc520, 22d0ecf4121576fac3f2aca4e369ac10], force=true in 795 msec 2023-07-22 00:07:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:43,452 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 00:07:43,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984463455 (current time:1689984463455). 2023-07-22 00:07:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x19dfae1c to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:43,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58c49679, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:43,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:43,515 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:43,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19dfae1c to 127.0.0.1:55465 2023-07-22 00:07:43,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:43,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x4df43b60 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:43,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db771d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:43,627 DEBUG [hconnection-0x7461a055-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:43,630 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:43,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:43,639 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:43,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4df43b60 to 127.0.0.1:55465 2023-07-22 00:07:43,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:43,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 00:07:43,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:43,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,644 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,645 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689985063645 2023-07-22 00:07:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,646 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:43,646 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:43,650 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:43,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-22 00:07:43,654 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:43,655 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689985063655 2023-07-22 00:07:43,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,675 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 00:07:43,675 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,676 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 00:07:43,676 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 00:07:43,677 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,677 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,679 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,679 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,679 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,679 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,680 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,680 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,686 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,686 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,687 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,694 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 00:07:43,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dead17[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:43,697 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 00:07:43,697 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,699 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:43,700 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,700 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:43,700 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:07:43,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,700 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. started... 2023-07-22 00:07:43,700 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:07:43,702 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for afb0684e821bd5a7a5aebcc40f68ea03: 2023-07-22 00:07:43,703 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,703 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:43,703 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/57dc403255ae4474952bc42128f3bc41.2b62bd75f3c82d12a790f8414d2bc520->hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41-top, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/abdbb222b67d4d7cb5fc42202f56f6ce.22d0ecf4121576fac3f2aca4e369ac10->hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce-top] hfiles 2023-07-22 00:07:43,703 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/57dc403255ae4474952bc42128f3bc41.2b62bd75f3c82d12a790f8414d2bc520 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,704 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/abdbb222b67d4d7cb5fc42202f56f6ce.22d0ecf4121576fac3f2aca4e369ac10 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,707 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,707 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,707 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,737 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. completed. 2023-07-22 00:07:43,738 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:07:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:07:43,745 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,745 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,746 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,749 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:43,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:07:43,750 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:43,751 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 00:07:43,751 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:43,751 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:43,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 00:07:43,751 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,751 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,753 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,754 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,755 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,765 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,767 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,775 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,780 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:07:43,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:07:43,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:07:43,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,781 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,781 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 00:07:43,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,901 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689984463645Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463781 (+136 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463781Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463789 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463824 (+35 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689984463898 (+74 ms) 2023-07-22 00:07:43,904 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:43,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 255 msec 2023-07-22 00:07:43,951 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:43,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:43,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:43,952 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952 2023-07-22 00:07:43,953 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35929, tgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952, rawTgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:43,987 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:07:43,987 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1956965218_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,987 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 00:07:44,005 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:44,032 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:07:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,067 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,068 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,068 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,069 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,069 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,070 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,174 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-3077444674990989710.jar 2023-07-22 00:07:44,174 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,175 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,176 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,177 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,178 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:44,178 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:44,179 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:44,179 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:44,182 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:44,183 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,183 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,184 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,185 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:44,186 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:45,324 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:45,329 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 00:07:45,331 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 00:07:45,567 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:45,567 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:45,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:52,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:54,591 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:59,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0005_000001 (auth:SIMPLE) 2023-07-22 00:08:00,778 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:00,781 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:00,791 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,791 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:00,792 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:00,792 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,792 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 00:08:00,792 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 00:08:00,793 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,793 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 00:08:00,793 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984463952/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 00:08:00,803 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:00,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:00,811 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984480811"}]},"ts":"1689984480811"} 2023-07-22 00:08:00,812 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 00:08:00,814 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 00:08:00,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, UNASSIGN}] 2023-07-22 00:08:00,817 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, UNASSIGN 2023-07-22 00:08:00,818 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=afb0684e821bd5a7a5aebcc40f68ea03, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:00,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984480818"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984480818"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984480818"}]},"ts":"1689984480818"} 2023-07-22 00:08:00,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure afb0684e821bd5a7a5aebcc40f68ea03, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:08:00,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:00,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:08:00,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing afb0684e821bd5a7a5aebcc40f68ea03, disabling compactions & flushes 2023-07-22 00:08:00,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:08:00,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:08:00,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. after waiting 0 ms 2023-07-22 00:08:00,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:08:00,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 00:08:00,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:00,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03. 2023-07-22 00:08:00,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for afb0684e821bd5a7a5aebcc40f68ea03: 2023-07-22 00:08:00,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:08:00,987 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=afb0684e821bd5a7a5aebcc40f68ea03, regionState=CLOSED 2023-07-22 00:08:00,987 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984480987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984480987"}]},"ts":"1689984480987"} 2023-07-22 00:08:00,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 00:08:00,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure afb0684e821bd5a7a5aebcc40f68ea03, server=jenkins-hbase4.apache.org,45387,1689984379695 in 171 msec 2023-07-22 00:08:00,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 00:08:00,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=afb0684e821bd5a7a5aebcc40f68ea03, UNASSIGN in 178 msec 2023-07-22 00:08:00,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984480995"}]},"ts":"1689984480995"} 2023-07-22 00:08:01,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 00:08:01,002 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 00:08:01,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 199 msec 2023-07-22 00:08:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:01,114 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 00:08:01,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,119 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,121 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,122 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,125 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,125 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,125 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,127 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 00:08:01,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,143 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:08:01,144 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:08:01,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:08:01,146 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/recovered.edits] 2023-07-22 00:08:01,146 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/recovered.edits] 2023-07-22 00:08:01,147 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/recovered.edits] 2023-07-22 00:08:01,154 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/cf/abdbb222b67d4d7cb5fc42202f56f6ce 2023-07-22 00:08:01,154 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/57dc403255ae4474952bc42128f3bc41.2b62bd75f3c82d12a790f8414d2bc520 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/57dc403255ae4474952bc42128f3bc41.2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:08:01,154 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/cf/57dc403255ae4474952bc42128f3bc41 2023-07-22 00:08:01,160 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/abdbb222b67d4d7cb5fc42202f56f6ce.22d0ecf4121576fac3f2aca4e369ac10 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/cf/abdbb222b67d4d7cb5fc42202f56f6ce.22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:08:01,162 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/recovered.edits/8.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10/recovered.edits/8.seqid 2023-07-22 00:08:01,163 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/22d0ecf4121576fac3f2aca4e369ac10 2023-07-22 00:08:01,163 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/recovered.edits/8.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520/recovered.edits/8.seqid 2023-07-22 00:08:01,165 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2b62bd75f3c82d12a790f8414d2bc520 2023-07-22 00:08:01,166 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/recovered.edits/12.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03/recovered.edits/12.seqid 2023-07-22 00:08:01,167 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/afb0684e821bd5a7a5aebcc40f68ea03 2023-07-22 00:08:01,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 00:08:01,169 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,172 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 00:08:01,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 00:08:01,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 00:08:01,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481177"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 00:08:01,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => afb0684e821bd5a7a5aebcc40f68ea03, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984461687.afb0684e821bd5a7a5aebcc40f68ea03.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 00:08:01,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 00:08:01,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984481180"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,187 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 00:08:01,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 75 msec 2023-07-22 00:08:01,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 00:08:01,233 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 00:08:01,234 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481239"}]},"ts":"1689984481239"} 2023-07-22 00:08:01,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 00:08:01,242 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 00:08:01,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, UNASSIGN}] 2023-07-22 00:08:01,246 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, UNASSIGN 2023-07-22 00:08:01,246 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, UNASSIGN 2023-07-22 00:08:01,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=07f4dc4362324d9fcce0bf4aa302b64f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:01,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481247"}]},"ts":"1689984481247"} 2023-07-22 00:08:01,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b61e62d5695ac4edbd83721d82cd5579, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:01,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481247"}]},"ts":"1689984481247"} 2023-07-22 00:08:01,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 07f4dc4362324d9fcce0bf4aa302b64f, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:08:01,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure b61e62d5695ac4edbd83721d82cd5579, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:08:01,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:08:01,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:08:01,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07f4dc4362324d9fcce0bf4aa302b64f, disabling compactions & flushes 2023-07-22 00:08:01,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:08:01,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:08:01,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b61e62d5695ac4edbd83721d82cd5579, disabling compactions & flushes 2023-07-22 00:08:01,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. after waiting 0 ms 2023-07-22 00:08:01,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:08:01,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:08:01,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:08:01,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. after waiting 0 ms 2023-07-22 00:08:01,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:08:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:01,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:01,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:01,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579. 2023-07-22 00:08:01,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b61e62d5695ac4edbd83721d82cd5579: 2023-07-22 00:08:01,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f. 2023-07-22 00:08:01,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07f4dc4362324d9fcce0bf4aa302b64f: 2023-07-22 00:08:01,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:08:01,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b61e62d5695ac4edbd83721d82cd5579, regionState=CLOSED 2023-07-22 00:08:01,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:08:01,418 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481418"}]},"ts":"1689984481418"} 2023-07-22 00:08:01,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=07f4dc4362324d9fcce0bf4aa302b64f, regionState=CLOSED 2023-07-22 00:08:01,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481418"}]},"ts":"1689984481418"} 2023-07-22 00:08:01,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-22 00:08:01,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure b61e62d5695ac4edbd83721d82cd5579, server=jenkins-hbase4.apache.org,45387,1689984379695 in 168 msec 2023-07-22 00:08:01,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-22 00:08:01,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 07f4dc4362324d9fcce0bf4aa302b64f, server=jenkins-hbase4.apache.org,37101,1689984379582 in 171 msec 2023-07-22 00:08:01,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b61e62d5695ac4edbd83721d82cd5579, UNASSIGN in 179 msec 2023-07-22 00:08:01,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-22 00:08:01,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=07f4dc4362324d9fcce0bf4aa302b64f, UNASSIGN in 180 msec 2023-07-22 00:08:01,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481425"}]},"ts":"1689984481425"} 2023-07-22 00:08:01,429 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 00:08:01,431 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 00:08:01,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-07-22 00:08:01,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,542 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 00:08:01,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,548 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,549 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,553 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,553 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,553 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:08:01,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,554 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:08:01,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,556 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/recovered.edits] 2023-07-22 00:08:01,556 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,557 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/recovered.edits] 2023-07-22 00:08:01,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,558 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 00:08:01,563 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/cf/045a9c3a9b95478bae4f92b355b0811a 2023-07-22 00:08:01,563 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/cf/ef0cca3b4a1f4cd6bbe0e0aa5a298287 2023-07-22 00:08:01,571 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579/recovered.edits/9.seqid 2023-07-22 00:08:01,571 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f/recovered.edits/9.seqid 2023-07-22 00:08:01,572 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b61e62d5695ac4edbd83721d82cd5579 2023-07-22 00:08:01,572 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/07f4dc4362324d9fcce0bf4aa302b64f 2023-07-22 00:08:01,572 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 00:08:01,572 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 00:08:01,573 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-22 00:08:01,577 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722fe586193982b4782a3f1b41c7283c55e 2023-07-22 00:08:01,578 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072267d66df26c7d4225835a636707470ac8 2023-07-22 00:08:01,578 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 00:08:01,580 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,582 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 00:08:01,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 00:08:01,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 00:08:01,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481585"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481585"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,587 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:01,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b61e62d5695ac4edbd83721d82cd5579, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458975.b61e62d5695ac4edbd83721d82cd5579.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 07f4dc4362324d9fcce0bf4aa302b64f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458975.07f4dc4362324d9fcce0bf4aa302b64f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:01,587 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 00:08:01,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984481587"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 00:08:01,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-22 00:08:01,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 00:08:01,662 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 00:08:01,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 00:08:01,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 00:08:01,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 00:08:01,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,704 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3988 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:57034 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:40684 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-119070673_1 at /127.0.0.1:50180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:43012 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:40361 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=907 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 538) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6994 (was 7426) 2023-07-22 00:08:01,705 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-22 00:08:01,726 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=644, ProcessCount=180, AvailableMemoryMB=6993 2023-07-22 00:08:01,726 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-22 00:08:01,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:08:01,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:01,732 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:08:01,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 00:08:01,733 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:08:01,736 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:01,736 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:01,737 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f empty. 2023-07-22 00:08:01,737 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db empty. 2023-07-22 00:08:01,737 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:01,737 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:01,737 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 00:08:01,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:01,755 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 00:08:01,759 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 476f57ebbde3949b09b73d124aa884db, NAME => 'testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:08:01,763 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4b24799ec54f09e0d15259461271ac6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4b24799ec54f09e0d15259461271ac6f, disabling compactions & flushes 2023-07-22 00:08:01,801 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. after waiting 0 ms 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:01,801 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:01,801 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4b24799ec54f09e0d15259461271ac6f: 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 476f57ebbde3949b09b73d124aa884db, disabling compactions & flushes 2023-07-22 00:08:01,802 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. after waiting 0 ms 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:01,802 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:01,802 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 476f57ebbde3949b09b73d124aa884db: 2023-07-22 00:08:01,812 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:08:01,816 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984481815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481815"}]},"ts":"1689984481815"} 2023-07-22 00:08:01,816 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984481815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481815"}]},"ts":"1689984481815"} 2023-07-22 00:08:01,819 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:08:01,820 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:08:01,820 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481820"}]},"ts":"1689984481820"} 2023-07-22 00:08:01,822 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 00:08:01,827 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:08:01,828 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:08:01,828 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:08:01,828 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:08:01,828 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:08:01,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, ASSIGN}] 2023-07-22 00:08:01,831 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, ASSIGN 2023-07-22 00:08:01,832 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, ASSIGN 2023-07-22 00:08:01,832 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45387,1689984379695; forceNewPlan=false, retain=false 2023-07-22 00:08:01,832 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:08:01,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:01,983 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:08:01,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=476f57ebbde3949b09b73d124aa884db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:01,986 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4b24799ec54f09e0d15259461271ac6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:01,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984481986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481986"}]},"ts":"1689984481986"} 2023-07-22 00:08:01,986 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984481986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481986"}]},"ts":"1689984481986"} 2023-07-22 00:08:01,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 476f57ebbde3949b09b73d124aa884db, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:08:01,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 4b24799ec54f09e0d15259461271ac6f, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:08:02,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 476f57ebbde3949b09b73d124aa884db, NAME => 'testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:08:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. service=AccessControlService 2023-07-22 00:08:02,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:02,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b24799ec54f09e0d15259461271ac6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:08:02,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. service=AccessControlService 2023-07-22 00:08:02,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:02,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,151 INFO [StoreOpener-4b24799ec54f09e0d15259461271ac6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,151 INFO [StoreOpener-476f57ebbde3949b09b73d124aa884db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,152 DEBUG [StoreOpener-4b24799ec54f09e0d15259461271ac6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf 2023-07-22 00:08:02,152 DEBUG [StoreOpener-4b24799ec54f09e0d15259461271ac6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf 2023-07-22 00:08:02,152 DEBUG [StoreOpener-476f57ebbde3949b09b73d124aa884db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf 2023-07-22 00:08:02,153 DEBUG [StoreOpener-476f57ebbde3949b09b73d124aa884db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf 2023-07-22 00:08:02,153 INFO [StoreOpener-4b24799ec54f09e0d15259461271ac6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b24799ec54f09e0d15259461271ac6f columnFamilyName cf 2023-07-22 00:08:02,153 INFO [StoreOpener-476f57ebbde3949b09b73d124aa884db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 476f57ebbde3949b09b73d124aa884db columnFamilyName cf 2023-07-22 00:08:02,154 INFO [StoreOpener-476f57ebbde3949b09b73d124aa884db-1] regionserver.HStore(310): Store=476f57ebbde3949b09b73d124aa884db/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:02,154 INFO [StoreOpener-4b24799ec54f09e0d15259461271ac6f-1] regionserver.HStore(310): Store=4b24799ec54f09e0d15259461271ac6f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:02,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:02,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:02,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:02,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:02,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b24799ec54f09e0d15259461271ac6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75374533, jitterRate=0.12316806614398956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:02,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b24799ec54f09e0d15259461271ac6f: 2023-07-22 00:08:02,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 476f57ebbde3949b09b73d124aa884db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65378470, jitterRate=-0.02578487992286682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:02,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 476f57ebbde3949b09b73d124aa884db: 2023-07-22 00:08:02,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f., pid=94, masterSystemTime=1689984482144 2023-07-22 00:08:02,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db., pid=93, masterSystemTime=1689984482143 2023-07-22 00:08:02,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:02,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:02,165 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4b24799ec54f09e0d15259461271ac6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,165 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482165"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984482165"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984482165"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984482165"}]},"ts":"1689984482165"} 2023-07-22 00:08:02,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,165 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=476f57ebbde3949b09b73d124aa884db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,165 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482165"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984482165"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984482165"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984482165"}]},"ts":"1689984482165"} 2023-07-22 00:08:02,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-22 00:08:02,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 4b24799ec54f09e0d15259461271ac6f, server=jenkins-hbase4.apache.org,45387,1689984379695 in 176 msec 2023-07-22 00:08:02,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-22 00:08:02,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 476f57ebbde3949b09b73d124aa884db, server=jenkins-hbase4.apache.org,37101,1689984379582 in 182 msec 2023-07-22 00:08:02,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, ASSIGN in 347 msec 2023-07-22 00:08:02,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-22 00:08:02,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, ASSIGN in 348 msec 2023-07-22 00:08:02,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:08:02,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984482179"}]},"ts":"1689984482179"} 2023-07-22 00:08:02,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 00:08:02,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:08:02,184 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 00:08:02,186 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:02,188 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,188 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,188 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,188 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,191 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 462 msec 2023-07-22 00:08:02,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,343 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 00:08:02,345 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:02,345 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,347 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:02,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984482360 (current time:1689984482360). 2023-07-22 00:08:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x77dc38ff to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:02,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@791bc874, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:02,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:02,378 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77dc38ff to 127.0.0.1:55465 2023-07-22 00:08:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x3826c24f to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:02,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eab0e74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:02,386 DEBUG [hconnection-0x9d43bbd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:02,389 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:02,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:02,395 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:02,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3826c24f to 127.0.0.1:55465 2023-07-22 00:08:02,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:02,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:02,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:02,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:02,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:02,401 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:02,402 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985082402 2023-07-22 00:08:02,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:02,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:02,403 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:02,403 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:02,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:02,404 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:02,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 00:08:02,408 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:02,409 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985082409 2023-07-22 00:08:02,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,423 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 00:08:02,423 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:02,426 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 00:08:02,426 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:08:02,427 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,427 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,434 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,434 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,434 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,434 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,434 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,434 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,435 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,435 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:02,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,436 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:02,436 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:02,438 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:02,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,439 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:02,439 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:02,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,441 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:02,441 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:02,441 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:02,442 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,442 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:02,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,443 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:02,443 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:02,443 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,443 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:02,443 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,444 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:02,444 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,444 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:02,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:02,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:02,450 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,450 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:02,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:02,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:02,454 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:08:02,454 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,456 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:02,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:02,457 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,457 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:02,457 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. started... 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:08:02,457 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 476f57ebbde3949b09b73d124aa884db: 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:02,458 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. started... 2023-07-22 00:08:02,458 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,458 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:02,458 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:02,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b24799ec54f09e0d15259461271ac6f: 2023-07-22 00:08:02,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:02,460 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:02,461 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:02,492 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. completed. 2023-07-22 00:08:02,493 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:02,493 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:08:02,494 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,494 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:02,495 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:02,495 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:02,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:08:02,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:08:02,503 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:02,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:02,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:02,505 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:02,705 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:02,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:02,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:02,708 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:08:02,887 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. completed. 2023-07-22 00:08:02,887 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:02,887 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:08:02,889 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,889 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:02,889 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:02,890 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:02,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:08:02,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:08:02,897 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 00:08:02,897 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:02,897 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:02,897 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,897 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:02,902 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,902 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,902 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,903 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:02,903 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,904 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,905 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,907 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,907 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:02,907 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,913 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,912 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:02,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:02,912 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:02,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:02,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:08:02,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:08:02,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:02,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,008 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:03,010 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:08:03,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 00:08:03,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,016 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689984482402Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689984482936 (+534 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689984482936Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689984482936Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689984482943 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689984482959 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689984483016 (+57 ms) 2023-07-22 00:08:03,021 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 618 msec 2023-07-22 00:08:03,510 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:03,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45387] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:03,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:03,529 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,529 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:03,530 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:03,543 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984483543 (current time:1689984483543). 2023-07-22 00:08:03,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:03,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x06069f61 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4db7c433, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,560 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06069f61 to 127.0.0.1:55465 2023-07-22 00:08:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x48f22373 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7abd509b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,668 DEBUG [hconnection-0x95895a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,670 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,679 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48f22373 to 127.0.0.1:55465 2023-07-22 00:08:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,691 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,692 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985083692 2023-07-22 00:08:03,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,693 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:03,693 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:03,699 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-22 00:08:03,704 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,704 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985083704 2023-07-22 00:08:03,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,720 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 00:08:03,720 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,721 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 00:08:03,722 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:08:03,791 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,791 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,793 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,793 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,793 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,793 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,793 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,794 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,794 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,795 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,795 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,795 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:03,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,796 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,796 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,798 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,798 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,798 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,798 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,800 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,804 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,804 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,804 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,809 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,809 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,809 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,809 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,811 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8a81b2a[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8a81b2a[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:03,816 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:08:03,817 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,821 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,821 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,822 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,822 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,822 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. started... 2023-07-22 00:08:03,822 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,822 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,822 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:03,823 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. started... 2023-07-22 00:08:03,823 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b24799ec54f09e0d15259461271ac6f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 00:08:03,823 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,823 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:03,823 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 476f57ebbde3949b09b73d124aa884db 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 00:08:03,825 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,825 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,825 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,859 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c 2023-07-22 00:08:03,862 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5 2023-07-22 00:08:03,869 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/.tmp/cf/ff84cb23100e4361b241909b6ee8c9c9 2023-07-22 00:08:03,876 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/.tmp/cf/ff84cb23100e4361b241909b6ee8c9c9 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9 2023-07-22 00:08:03,881 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9, entries=45, sequenceid=6, filesize=12.7 K 2023-07-22 00:08:03,883 INFO [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4b24799ec54f09e0d15259461271ac6f in 60ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:03,883 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 00:08:03,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b24799ec54f09e0d15259461271ac6f: 2023-07-22 00:08:03,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:03,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9] hfiles 2023-07-22 00:08:03,884 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,900 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/.tmp/cf/a72387e3d8654be6be85a673890b2368 2023-07-22 00:08:03,907 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/.tmp/cf/a72387e3d8654be6be85a673890b2368 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368 2023-07-22 00:08:03,914 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368, entries=5, sequenceid=6, filesize=5.8 K 2023-07-22 00:08:03,915 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 476f57ebbde3949b09b73d124aa884db in 92ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:03,921 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 476f57ebbde3949b09b73d124aa884db: 2023-07-22 00:08:03,921 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,921 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:03,922 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368] hfiles 2023-07-22 00:08:03,922 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,938 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. completed. 2023-07-22 00:08:03,938 DEBUG [rs(jenkins-hbase4.apache.org,45387,1689984379695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:08:03,940 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,940 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,940 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,940 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,942 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. completed. 2023-07-22 00:08:03,943 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:08:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,944 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,945 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,945 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,945 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45387,1689984379695': 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:08:03,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:08:03,955 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 00:08:03,955 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:03,955 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:03,955 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,955 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:03,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,959 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,959 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,960 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,960 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,960 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,960 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,962 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,963 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,963 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,971 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,971 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,973 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5] mob files 2023-07-22 00:08:03,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c 2023-07-22 00:08:03,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5 2023-07-22 00:08:03,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,995 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:03,997 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:08:04,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 00:08:04,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,034 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689984483693Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689984483985 (+292 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689984483985Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689984483985Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689984483988 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689984483997 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689984484033 (+36 ms) 2023-07-22 00:08:04,037 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:04,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 342 msec 2023-07-22 00:08:04,297 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:04,300 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300 2023-07-22 00:08:04,300 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35929, tgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300, rawTgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:08:04,325 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:08:04,325 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-106228525_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,325 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 00:08:04,340 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,427 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,427 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,427 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,428 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,428 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,522 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-6666930242616304180.jar 2023-07-22 00:08:04,522 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,523 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,523 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,524 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,524 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,525 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:04,525 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:08:04,525 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:08:04,526 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:08:04,526 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:08:04,527 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:08:04,528 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:08:04,528 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:08:04,528 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:08:04,529 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:08:04,529 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:08:04,530 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:04,530 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:04,531 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:04,531 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:04,531 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:04,532 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:04,532 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:05,363 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:08:05,366 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 00:08:05,674 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:05,675 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:05,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0005_000001 (auth:SIMPLE) 2023-07-22 00:08:06,452 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:06,594 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:13,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:15,775 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:15,788 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:15,808 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,808 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:15,809 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:15,809 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,810 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 00:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 00:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 00:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984484300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 00:08:15,820 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,821 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:15,826 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984495826"}]},"ts":"1689984495826"} 2023-07-22 00:08:15,827 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 00:08:15,829 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 00:08:15,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, UNASSIGN}] 2023-07-22 00:08:15,833 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, UNASSIGN 2023-07-22 00:08:15,833 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, UNASSIGN 2023-07-22 00:08:15,834 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4b24799ec54f09e0d15259461271ac6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:15,834 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=476f57ebbde3949b09b73d124aa884db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:15,834 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984495834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984495834"}]},"ts":"1689984495834"} 2023-07-22 00:08:15,834 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984495834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984495834"}]},"ts":"1689984495834"} 2023-07-22 00:08:15,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 4b24799ec54f09e0d15259461271ac6f, server=jenkins-hbase4.apache.org,45387,1689984379695}] 2023-07-22 00:08:15,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 476f57ebbde3949b09b73d124aa884db, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:08:15,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:15,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:15,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b24799ec54f09e0d15259461271ac6f, disabling compactions & flushes 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 476f57ebbde3949b09b73d124aa884db, disabling compactions & flushes 2023-07-22 00:08:15,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. after waiting 0 ms 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:15,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. after waiting 0 ms 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:16,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:16,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:16,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db. 2023-07-22 00:08:16,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 476f57ebbde3949b09b73d124aa884db: 2023-07-22 00:08:16,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:16,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:16,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f. 2023-07-22 00:08:16,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b24799ec54f09e0d15259461271ac6f: 2023-07-22 00:08:16,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:16,016 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=476f57ebbde3949b09b73d124aa884db, regionState=CLOSED 2023-07-22 00:08:16,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984496016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496016"}]},"ts":"1689984496016"} 2023-07-22 00:08:16,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:16,017 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4b24799ec54f09e0d15259461271ac6f, regionState=CLOSED 2023-07-22 00:08:16,017 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984496017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496017"}]},"ts":"1689984496017"} 2023-07-22 00:08:16,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-22 00:08:16,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 476f57ebbde3949b09b73d124aa884db, server=jenkins-hbase4.apache.org,37101,1689984379582 in 181 msec 2023-07-22 00:08:16,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-22 00:08:16,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 4b24799ec54f09e0d15259461271ac6f, server=jenkins-hbase4.apache.org,45387,1689984379695 in 182 msec 2023-07-22 00:08:16,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=476f57ebbde3949b09b73d124aa884db, UNASSIGN in 189 msec 2023-07-22 00:08:16,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-22 00:08:16,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b24799ec54f09e0d15259461271ac6f, UNASSIGN in 190 msec 2023-07-22 00:08:16,022 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496022"}]},"ts":"1689984496022"} 2023-07-22 00:08:16,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 00:08:16,024 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 00:08:16,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 204 msec 2023-07-22 00:08:16,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:16,128 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 00:08:16,129 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,133 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,134 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,136 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,139 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:16,139 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:16,139 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,139 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,139 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,139 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,141 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/recovered.edits] 2023-07-22 00:08:16,141 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/recovered.edits] 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,143 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,142 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 00:08:16,146 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/cf/ff84cb23100e4361b241909b6ee8c9c9 2023-07-22 00:08:16,147 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/cf/a72387e3d8654be6be85a673890b2368 2023-07-22 00:08:16,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f/recovered.edits/9.seqid 2023-07-22 00:08:16,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b24799ec54f09e0d15259461271ac6f 2023-07-22 00:08:16,149 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db/recovered.edits/9.seqid 2023-07-22 00:08:16,150 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testEmptyExportFileSystemState/476f57ebbde3949b09b73d124aa884db 2023-07-22 00:08:16,150 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 00:08:16,150 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 00:08:16,151 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-22 00:08:16,154 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307229b5fa1b921d34e43921ddc0cc036ea7c 2023-07-22 00:08:16,155 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230722a5dcf6ef50c5455780ff91c46e5a02a5 2023-07-22 00:08:16,156 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 00:08:16,158 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,160 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 00:08:16,162 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 00:08:16,163 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,163 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 00:08:16,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984496163"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984496163"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:16,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 476f57ebbde3949b09b73d124aa884db, NAME => 'testtb-testEmptyExportFileSystemState,,1689984481728.476f57ebbde3949b09b73d124aa884db.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4b24799ec54f09e0d15259461271ac6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984481728.4b24799ec54f09e0d15259461271ac6f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:16,165 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 00:08:16,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984496165"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,166 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 00:08:16,168 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-07-22 00:08:16,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 00:08:16,252 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 00:08:16,262 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 00:08:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:16,265 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 00:08:16,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:16,301 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 757) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1376023255_1 at /127.0.0.1:58892 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:33449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:56740 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:58914 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4788 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1376023255_1 at /127.0.0.1:56718 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:36875 from appattempt_1689984387206_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-106228525_17 at /127.0.0.1:40242 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=787 (was 644) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6239 (was 6993) 2023-07-22 00:08:16,301 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-22 00:08:16,325 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=787, ProcessCount=180, AvailableMemoryMB=6239 2023-07-22 00:08:16,326 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-22 00:08:16,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 00:08:16,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:08:16,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 00:08:16,335 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:08:16,337 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,337 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,338 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae empty. 2023-07-22 00:08:16,338 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f empty. 2023-07-22 00:08:16,339 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,339 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 00:08:16,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,368 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 00:08:16,370 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 158c6032ee2d76937f2e61a66b8aa71f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:08:16,370 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => fceed3cc9b0b500343069696653ba3ae, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp 2023-07-22 00:08:16,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing fceed3cc9b0b500343069696653ba3ae, disabling compactions & flushes 2023-07-22 00:08:16,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. after waiting 0 ms 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for fceed3cc9b0b500343069696653ba3ae: 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 158c6032ee2d76937f2e61a66b8aa71f, disabling compactions & flushes 2023-07-22 00:08:16,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. after waiting 0 ms 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 158c6032ee2d76937f2e61a66b8aa71f: 2023-07-22 00:08:16,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:08:16,400 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496400"}]},"ts":"1689984496400"} 2023-07-22 00:08:16,400 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496400"}]},"ts":"1689984496400"} 2023-07-22 00:08:16,402 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:08:16,403 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:08:16,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496403"}]},"ts":"1689984496403"} 2023-07-22 00:08:16,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 00:08:16,408 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:08:16,409 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:08:16,409 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:08:16,409 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:08:16,409 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:08:16,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, ASSIGN}] 2023-07-22 00:08:16,412 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, ASSIGN 2023-07-22 00:08:16,412 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, ASSIGN 2023-07-22 00:08:16,413 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37101,1689984379582; forceNewPlan=false, retain=false 2023-07-22 00:08:16,413 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40135,1689984379650; forceNewPlan=false, retain=false 2023-07-22 00:08:16,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,563 INFO [jenkins-hbase4:34721] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:08:16,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=158c6032ee2d76937f2e61a66b8aa71f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:16,567 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fceed3cc9b0b500343069696653ba3ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:16,567 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984496566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984496566"}]},"ts":"1689984496566"} 2023-07-22 00:08:16,567 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984496566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984496566"}]},"ts":"1689984496566"} 2023-07-22 00:08:16,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure fceed3cc9b0b500343069696653ba3ae, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:08:16,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 158c6032ee2d76937f2e61a66b8aa71f, server=jenkins-hbase4.apache.org,40135,1689984379650}] 2023-07-22 00:08:16,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fceed3cc9b0b500343069696653ba3ae, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:08:16,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. service=AccessControlService 2023-07-22 00:08:16,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:16,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 158c6032ee2d76937f2e61a66b8aa71f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:08:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. service=AccessControlService 2023-07-22 00:08:16,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,734 INFO [StoreOpener-fceed3cc9b0b500343069696653ba3ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,735 INFO [StoreOpener-158c6032ee2d76937f2e61a66b8aa71f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,736 DEBUG [StoreOpener-fceed3cc9b0b500343069696653ba3ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf 2023-07-22 00:08:16,736 DEBUG [StoreOpener-fceed3cc9b0b500343069696653ba3ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf 2023-07-22 00:08:16,737 INFO [StoreOpener-fceed3cc9b0b500343069696653ba3ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fceed3cc9b0b500343069696653ba3ae columnFamilyName cf 2023-07-22 00:08:16,737 DEBUG [StoreOpener-158c6032ee2d76937f2e61a66b8aa71f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf 2023-07-22 00:08:16,737 DEBUG [StoreOpener-158c6032ee2d76937f2e61a66b8aa71f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf 2023-07-22 00:08:16,737 INFO [StoreOpener-158c6032ee2d76937f2e61a66b8aa71f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 158c6032ee2d76937f2e61a66b8aa71f columnFamilyName cf 2023-07-22 00:08:16,738 INFO [StoreOpener-fceed3cc9b0b500343069696653ba3ae-1] regionserver.HStore(310): Store=fceed3cc9b0b500343069696653ba3ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:16,739 INFO [StoreOpener-158c6032ee2d76937f2e61a66b8aa71f-1] regionserver.HStore(310): Store=158c6032ee2d76937f2e61a66b8aa71f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:16,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:16,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:16,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:16,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 158c6032ee2d76937f2e61a66b8aa71f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61045798, jitterRate=-0.09034672379493713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:16,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 158c6032ee2d76937f2e61a66b8aa71f: 2023-07-22 00:08:16,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f., pid=109, masterSystemTime=1689984496726 2023-07-22 00:08:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:16,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=158c6032ee2d76937f2e61a66b8aa71f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:16,758 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984496758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984496758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984496758"}]},"ts":"1689984496758"} 2023-07-22 00:08:16,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:16,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fceed3cc9b0b500343069696653ba3ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72007995, jitterRate=0.07300274074077606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:16,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fceed3cc9b0b500343069696653ba3ae: 2023-07-22 00:08:16,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae., pid=108, masterSystemTime=1689984496724 2023-07-22 00:08:16,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fceed3cc9b0b500343069696653ba3ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:16,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496763"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984496763"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984496763"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984496763"}]},"ts":"1689984496763"} 2023-07-22 00:08:16,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 00:08:16,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 158c6032ee2d76937f2e61a66b8aa71f, server=jenkins-hbase4.apache.org,40135,1689984379650 in 191 msec 2023-07-22 00:08:16,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 00:08:16,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure fceed3cc9b0b500343069696653ba3ae, server=jenkins-hbase4.apache.org,37101,1689984379582 in 194 msec 2023-07-22 00:08:16,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, ASSIGN in 356 msec 2023-07-22 00:08:16,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-22 00:08:16,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, ASSIGN in 358 msec 2023-07-22 00:08:16,773 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:08:16,773 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496773"}]},"ts":"1689984496773"} 2023-07-22 00:08:16,774 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 00:08:16,778 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:08:16,778 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 00:08:16,780 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:16,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,782 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 455 msec 2023-07-22 00:08:16,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,943 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 00:08:16,945 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,946 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:16,947 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:16,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:16,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984496970 (current time:1689984496970). 2023-07-22 00:08:16,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x356c8347 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:16,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a84a016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:16,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:16,987 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x356c8347 to 127.0.0.1:55465 2023-07-22 00:08:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc832a4 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:17,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2deff0c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:17,005 DEBUG [hconnection-0x2c4617a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,009 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,016 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc832a4 to 127.0.0.1:55465 2023-07-22 00:08:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:17,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:17,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,022 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,022 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689985097022 2023-07-22 00:08:17,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,024 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:17,024 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:17,025 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-22 00:08:17,032 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,033 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689985097033 2023-07-22 00:08:17,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,045 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:17,045 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,046 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 00:08:17,046 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 00:08:17,047 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,047 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,048 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,048 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,048 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,048 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,049 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,049 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,049 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,049 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,050 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,057 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,064 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,074 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,074 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,074 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,074 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,074 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@360488a7[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@360488a7[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:17,080 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 00:08:17,080 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,081 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,081 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,081 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,082 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:08:17,082 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,087 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,087 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,087 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,087 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:17,087 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,087 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,087 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:17,087 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. started... 2023-07-22 00:08:17,088 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fceed3cc9b0b500343069696653ba3ae: 2023-07-22 00:08:17,088 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,088 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,088 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:17,088 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,088 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,088 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,094 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,094 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,095 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:17,095 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. started... 2023-07-22 00:08:17,098 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 158c6032ee2d76937f2e61a66b8aa71f: 2023-07-22 00:08:17,098 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,098 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,098 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:17,124 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:17,125 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:17,126 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. completed. 2023-07-22 00:08:17,127 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:08:17,127 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. completed. 2023-07-22 00:08:17,127 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,127 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:08:17,130 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,130 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,130 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,130 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,133 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,133 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,133 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,133 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40135,1689984379650': 2023-07-22 00:08:17,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 00:08:17,141 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 00:08:17,141 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:17,141 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:17,142 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,142 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,146 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,146 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,147 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,147 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,149 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,150 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,150 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,153 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,153 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,155 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:08:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 00:08:17,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 00:08:17,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,214 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689984497022Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689984497171 (+149 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497171Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497171Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497174 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497187 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689984497213 (+26 ms) 2023-07-22 00:08:17,217 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 194 msec 2023-07-22 00:08:17,325 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:17,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40135] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:17,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37101] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:17,351 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,351 DEBUG [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:17,351 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:17,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984497361 (current time:1689984497361). 2023-07-22 00:08:17,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:17,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x715b0f7e to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:17,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50357f9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:17,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,377 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x715b0f7e to 127.0.0.1:55465 2023-07-22 00:08:17,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:17,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(139): Connect 0x6f098301 to 127.0.0.1:55465 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:17,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46804161, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:17,387 DEBUG [hconnection-0x3d320fa0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,390 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,397 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f098301 to 127.0.0.1:55465 2023-07-22 00:08:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,403 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,404 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689985097403 2023-07-22 00:08:17,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,406 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:17,406 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:17,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,407 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-22 00:08:17,411 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,411 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689985097411 2023-07-22 00:08:17,506 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:17,508 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:17,708 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:17,709 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:08:17,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,825 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:17,825 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,825 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 00:08:17,825 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 00:08:17,826 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,826 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,828 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,828 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,829 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,829 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,829 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,829 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,835 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,835 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,841 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,841 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,841 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,840 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,842 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,842 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,841 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,842 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45387,1689984379695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,842 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,843 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,843 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,843 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,843 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,846 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,846 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,846 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,846 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,846 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,846 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,847 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,847 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40135,1689984379650' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c22d65[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37101,1689984379582' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c22d65[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:17,852 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 00:08:17,852 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,852 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,857 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45387,1689984379695' in zk 2023-07-22 00:08:17,858 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,858 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,45387,1689984379695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,870 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,873 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,873 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:17,872 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,873 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,873 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. started... 2023-07-22 00:08:17,873 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:17,873 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. started... 2023-07-22 00:08:17,873 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 158c6032ee2d76937f2e61a66b8aa71f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 00:08:17,873 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fceed3cc9b0b500343069696653ba3ae 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 00:08:17,896 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604 2023-07-22 00:08:17,902 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b 2023-07-22 00:08:17,941 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/.tmp/cf/08734157dcbc4b08a446efa290ba5bf8 2023-07-22 00:08:17,952 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/.tmp/cf/08734157dcbc4b08a446efa290ba5bf8 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8 2023-07-22 00:08:17,957 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8, entries=47, sequenceid=6, filesize=13.3 K 2023-07-22 00:08:17,959 INFO [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 158c6032ee2d76937f2e61a66b8aa71f in 86ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:17,959 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:17,959 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 158c6032ee2d76937f2e61a66b8aa71f: 2023-07-22 00:08:17,960 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,960 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,960 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8] hfiles 2023-07-22 00:08:17,960 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,970 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. completed. 2023-07-22 00:08:17,970 DEBUG [rs(jenkins-hbase4.apache.org,40135,1689984379650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40135,1689984379650' in zk 2023-07-22 00:08:17,972 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,40135,1689984379650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40135,1689984379650': 2023-07-22 00:08:17,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40135,1689984379650' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 00:08:18,010 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:18,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:18,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:18,012 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:08:18,337 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/.tmp/cf/77742a4f754d420eb8bd077dc81b492a 2023-07-22 00:08:18,343 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/.tmp/cf/77742a4f754d420eb8bd077dc81b492a as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a 2023-07-22 00:08:18,359 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a, entries=3, sequenceid=6, filesize=5.4 K 2023-07-22 00:08:18,360 INFO [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for fceed3cc9b0b500343069696653ba3ae in 487ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:18,362 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fceed3cc9b0b500343069696653ba3ae: 2023-07-22 00:08:18,362 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,362 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:18,362 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a] hfiles 2023-07-22 00:08:18,362 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. completed. 2023-07-22 00:08:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37101,1689984379582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:18,375 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:18,375 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:18,375 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37101,1689984379582' in zk 2023-07-22 00:08:18,378 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:18,378 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,378 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:18,378 DEBUG [member: 'jenkins-hbase4.apache.org,37101,1689984379582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:18,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:18,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37101,1689984379582': 2023-07-22 00:08:18,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37101,1689984379582' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 00:08:18,388 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 00:08:18,388 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:18,388 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:18,388 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,388 INFO [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:18,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,391 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,399 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,400 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,402 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,403 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,403 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:18,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,407 DEBUG [(jenkins-hbase4.apache.org,34721,1689984378142)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:18,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,407 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 00:08:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,410 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604] mob files 2023-07-22 00:08:18,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b 2023-07-22 00:08:18,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604 2023-07-22 00:08:18,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 00:08:18,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,478 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689984497404Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689984498419 (+1015 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689984498419Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689984498419Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689984498426 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689984498447 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689984498477 (+30 ms) 2023-07-22 00:08:18,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:18,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.0760 sec 2023-07-22 00:08:18,512 DEBUG [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:18,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:18,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:18,513 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513 2023-07-22 00:08:18,514 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35929, tgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513, rawTgtDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513, srcFsUri=hdfs://localhost:35929, srcDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:08:18,540 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12 2023-07-22 00:08:18,540 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1998518734_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,540 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35929, inputRoot=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12, snapshotDir=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 00:08:18,555 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:18,585 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,585 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,586 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,586 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,586 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,586 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,587 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/hadoop-6655787046000559342.jar 2023-07-22 00:08:18,655 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,655 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,656 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,656 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,656 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,657 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:18,657 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:08:18,657 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:08:18,658 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:08:18,658 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:08:18,658 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:08:18,659 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:08:18,659 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:08:18,659 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:08:18,660 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:08:18,660 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:08:18,660 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:18,661 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:18,661 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:18,661 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:18,661 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:18,662 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:18,662 DEBUG [Listener at jenkins-hbase4.apache.org/36243] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:19,593 WARN [Listener at jenkins-hbase4.apache.org/36243] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:08:19,595 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 00:08:19,598 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-22 00:08:20,573 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:20,573 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:20,576 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:20,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:21,631 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:26,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:29,059 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:34,303 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984387206_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:35,871 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:35,871 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:35,890 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,890 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:35,891 INFO [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:35,891 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,892 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 00:08:35,892 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 00:08:35,892 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1008883346_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,892 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 00:08:35,892 DEBUG [Listener at jenkins-hbase4.apache.org/36243] snapshot.TestExportSnapshot(367): hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/export-test/export-1689984498513/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 00:08:35,900 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:35,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:35,905 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984515905"}]},"ts":"1689984515905"} 2023-07-22 00:08:35,906 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 00:08:35,907 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 00:08:35,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, UNASSIGN}] 2023-07-22 00:08:35,910 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, UNASSIGN 2023-07-22 00:08:35,910 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, UNASSIGN 2023-07-22 00:08:35,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fceed3cc9b0b500343069696653ba3ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:08:35,911 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=158c6032ee2d76937f2e61a66b8aa71f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:08:35,911 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984515911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984515911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984515911"}]},"ts":"1689984515911"} 2023-07-22 00:08:35,911 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984515911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984515911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984515911"}]},"ts":"1689984515911"} 2023-07-22 00:08:35,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure fceed3cc9b0b500343069696653ba3ae, server=jenkins-hbase4.apache.org,37101,1689984379582}] 2023-07-22 00:08:35,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 158c6032ee2d76937f2e61a66b8aa71f, server=jenkins-hbase4.apache.org,40135,1689984379650}] 2023-07-22 00:08:36,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:36,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fceed3cc9b0b500343069696653ba3ae, disabling compactions & flushes 2023-07-22 00:08:36,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. after waiting 0 ms 2023-07-22 00:08:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:36,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:36,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 158c6032ee2d76937f2e61a66b8aa71f, disabling compactions & flushes 2023-07-22 00:08:36,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:36,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:36,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. after waiting 0 ms 2023-07-22 00:08:36,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:36,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f. 2023-07-22 00:08:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:36,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 158c6032ee2d76937f2e61a66b8aa71f: 2023-07-22 00:08:36,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:36,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae. 2023-07-22 00:08:36,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fceed3cc9b0b500343069696653ba3ae: 2023-07-22 00:08:36,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:36,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=158c6032ee2d76937f2e61a66b8aa71f, regionState=CLOSED 2023-07-22 00:08:36,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:36,090 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984516090"}]},"ts":"1689984516090"} 2023-07-22 00:08:36,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fceed3cc9b0b500343069696653ba3ae, regionState=CLOSED 2023-07-22 00:08:36,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984516092"}]},"ts":"1689984516092"} 2023-07-22 00:08:36,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-22 00:08:36,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 158c6032ee2d76937f2e61a66b8aa71f, server=jenkins-hbase4.apache.org,40135,1689984379650 in 179 msec 2023-07-22 00:08:36,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-22 00:08:36,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure fceed3cc9b0b500343069696653ba3ae, server=jenkins-hbase4.apache.org,37101,1689984379582 in 180 msec 2023-07-22 00:08:36,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=158c6032ee2d76937f2e61a66b8aa71f, UNASSIGN in 187 msec 2023-07-22 00:08:36,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-22 00:08:36,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fceed3cc9b0b500343069696653ba3ae, UNASSIGN in 188 msec 2023-07-22 00:08:36,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984516099"}]},"ts":"1689984516099"} 2023-07-22 00:08:36,101 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 00:08:36,102 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 00:08:36,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 203 msec 2023-07-22 00:08:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:36,207 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 00:08:36,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,213 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37101] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,216 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:36,216 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:36,217 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,217 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,217 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,217 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:36,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:36,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:36,220 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:36,221 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,221 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:36,222 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,222 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:36,222 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,222 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:36,223 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,223 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:36,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 00:08:36,229 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/recovered.edits] 2023-07-22 00:08:36,236 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/cf/77742a4f754d420eb8bd077dc81b492a 2023-07-22 00:08:36,237 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf, FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/recovered.edits] 2023-07-22 00:08:36,242 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae/recovered.edits/9.seqid 2023-07-22 00:08:36,245 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fceed3cc9b0b500343069696653ba3ae 2023-07-22 00:08:36,247 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/cf/08734157dcbc4b08a446efa290ba5bf8 2023-07-22 00:08:36,251 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/recovered.edits/9.seqid to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f/recovered.edits/9.seqid 2023-07-22 00:08:36,252 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/158c6032ee2d76937f2e61a66b8aa71f 2023-07-22 00:08:36,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 00:08:36,253 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 00:08:36,254 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-22 00:08:36,258 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230722b19b8494015445b8b6a20572d13fff8b 2023-07-22 00:08:36,260 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604 to hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072231d29f97fa0d4673860d1d780823f604 2023-07-22 00:08:36,260 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 00:08:36,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,272 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 00:08:36,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 00:08:36,275 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,275 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 00:08:36,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984516275"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:36,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984516275"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:36,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:36,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fceed3cc9b0b500343069696653ba3ae, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496327.fceed3cc9b0b500343069696653ba3ae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 158c6032ee2d76937f2e61a66b8aa71f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496327.158c6032ee2d76937f2e61a66b8aa71f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:36,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 00:08:36,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984516278"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:36,280 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 00:08:36,283 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 75 msec 2023-07-22 00:08:36,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 00:08:36,325 INFO [Listener at jenkins-hbase4.apache.org/36243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 00:08:36,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 00:08:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 00:08:36,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34721] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,381 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 760) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:46520 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5429 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1008883346_17 at /127.0.0.1:59808 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:40743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2032093422_1 at /127.0.0.1:46488 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1998518734_17 at /127.0.0.1:56220 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b26ad62-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 911), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=851 (was 787) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6011 (was 6239) 2023-07-22 00:08:36,381 WARN [Listener at jenkins-hbase4.apache.org/36243] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-22 00:08:36,382 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 00:08:36,407 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:08:36,412 WARN [320788464@qtp-254132074-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34911] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-22 00:08:36,412 WARN [320788464@qtp-254132074-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34911] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-22 00:08:36,533 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689984387206_0007_01_000001 is : 143 2023-07-22 00:08:41,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:50,530 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:04,650 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:04,651 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:04,760 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 00:09:04,769 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 00:09:04,771 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:04,786 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:04,889 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:04,889 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 00:09:04,890 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 00:09:04,890 INFO [Listener at jenkins-hbase4.apache.org/36243] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d40e34 to 127.0.0.1:55465 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] util.JVMClusterUtil(257): Found active master hash=656295089, stopped=false 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:04,890 DEBUG [Listener at jenkins-hbase4.apache.org/36243] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 00:09:04,891 INFO [Listener at jenkins-hbase4.apache.org/36243] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:09:04,892 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:04,892 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:04,892 INFO [Listener at jenkins-hbase4.apache.org/36243] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 00:09:04,892 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:04,893 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:09:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/36243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6004cd9c to 127.0.0.1:55465 2023-07-22 00:09:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/36243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,893 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37101,1689984379582' ***** 2023-07-22 00:09:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/36243] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:04,893 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:04,893 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40135,1689984379650' ***** 2023-07-22 00:09:04,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:04,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:04,894 INFO [RS:0;jenkins-hbase4:37101] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/36243] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:04,894 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:04,894 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45387,1689984379695' ***** 2023-07-22 00:09:04,894 DEBUG [Listener at jenkins-hbase4.apache.org/36243] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:04,894 INFO [RS:1;jenkins-hbase4:40135] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:04,894 INFO [RS:1;jenkins-hbase4:40135] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:04,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:04,894 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:04,894 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:04,894 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:04,894 INFO [RS:1;jenkins-hbase4:40135] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:04,894 INFO [Listener at jenkins-hbase4.apache.org/36243] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:04,895 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:09:04,894 INFO [RS:0;jenkins-hbase4:37101] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:04,895 INFO [RS:2;jenkins-hbase4:45387] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:04,895 DEBUG [RS:1;jenkins-hbase4:40135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c879800 to 127.0.0.1:55465 2023-07-22 00:09:04,895 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:04,895 INFO [RS:2;jenkins-hbase4:45387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:04,895 INFO [RS:0;jenkins-hbase4:37101] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:04,895 INFO [RS:2;jenkins-hbase4:45387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:04,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:04,895 DEBUG [RS:1;jenkins-hbase4:40135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,895 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(3305): Received CLOSE for 824247b9a51097bdbc051855370286bf 2023-07-22 00:09:04,898 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(3305): Received CLOSE for 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:09:04,898 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:09:04,898 DEBUG [RS:0;jenkins-hbase4:37101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ab8cf89 to 127.0.0.1:55465 2023-07-22 00:09:04,900 DEBUG [RS:0;jenkins-hbase4:37101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,895 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:09:04,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 824247b9a51097bdbc051855370286bf, disabling compactions & flushes 2023-07-22 00:09:04,899 INFO [RS:1;jenkins-hbase4:40135] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:04,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:09:04,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:09:04,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. after waiting 0 ms 2023-07-22 00:09:04,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:09:04,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 824247b9a51097bdbc051855370286bf 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 00:09:04,900 DEBUG [RS:2;jenkins-hbase4:45387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b454d3d to 127.0.0.1:55465 2023-07-22 00:09:04,902 DEBUG [RS:2;jenkins-hbase4:45387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,901 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-22 00:09:04,904 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1478): Online Regions={824247b9a51097bdbc051855370286bf=hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf., 875272fc4f8e08f07ac8c0249092d9eb=hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb.} 2023-07-22 00:09:04,904 DEBUG [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1504): Waiting on 824247b9a51097bdbc051855370286bf, 875272fc4f8e08f07ac8c0249092d9eb 2023-07-22 00:09:04,901 INFO [RS:1;jenkins-hbase4:40135] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:04,903 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45387,1689984379695; all regions closed. 2023-07-22 00:09:04,905 INFO [RS:1;jenkins-hbase4:40135] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:04,905 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 00:09:04,906 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-22 00:09:04,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 00:09:04,909 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-22 00:09:04,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 00:09:04,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 00:09:04,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 00:09:04,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 00:09:04,909 DEBUG [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-22 00:09:04,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 00:09:04,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/.tmp/info/aa4b959c9a6d4005a7446e11437ea0a8 2023-07-22 00:09:04,933 DEBUG [RS:2;jenkins-hbase4:45387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs 2023-07-22 00:09:04,933 INFO [RS:2;jenkins-hbase4:45387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45387%2C1689984379695:(num 1689984381846) 2023-07-22 00:09:04,933 DEBUG [RS:2;jenkins-hbase4:45387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:04,933 INFO [RS:2;jenkins-hbase4:45387] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:04,933 INFO [RS:2;jenkins-hbase4:45387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:04,934 INFO [RS:2;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:04,934 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:04,934 INFO [RS:2;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:04,934 INFO [RS:2;jenkins-hbase4:45387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:04,935 INFO [RS:2;jenkins-hbase4:45387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45387 2023-07-22 00:09:04,936 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:04,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/info/a3a2b0e7fcb74eb78b4cb17a7d7826a8 2023-07-22 00:09:04,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/.tmp/info/aa4b959c9a6d4005a7446e11437ea0a8 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/info/aa4b959c9a6d4005a7446e11437ea0a8 2023-07-22 00:09:04,943 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:09:04,943 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:09:04,943 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:04,943 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:04,943 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:04,944 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:04,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/info/aa4b959c9a6d4005a7446e11437ea0a8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 00:09:04,945 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45387,1689984379695 2023-07-22 00:09:04,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3a2b0e7fcb74eb78b4cb17a7d7826a8 2023-07-22 00:09:04,945 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:04,945 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45387,1689984379695] 2023-07-22 00:09:04,946 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45387,1689984379695; numProcessing=1 2023-07-22 00:09:04,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 824247b9a51097bdbc051855370286bf in 45ms, sequenceid=6, compaction requested=false 2023-07-22 00:09:04,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/namespace/824247b9a51097bdbc051855370286bf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:09:04,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:04,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:09:04,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 824247b9a51097bdbc051855370286bf: 2023-07-22 00:09:04,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689984382598.824247b9a51097bdbc051855370286bf. 2023-07-22 00:09:04,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 875272fc4f8e08f07ac8c0249092d9eb, disabling compactions & flushes 2023-07-22 00:09:04,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:09:04,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:09:04,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. after waiting 0 ms 2023-07-22 00:09:04,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:09:04,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 875272fc4f8e08f07ac8c0249092d9eb 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 00:09:04,954 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45387,1689984379695 already deleted, retry=false 2023-07-22 00:09:04,954 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45387,1689984379695 expired; onlineServers=2 2023-07-22 00:09:04,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/rep_barrier/d82c23cb24084749a2adc62f1012d138 2023-07-22 00:09:04,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d82c23cb24084749a2adc62f1012d138 2023-07-22 00:09:04,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/.tmp/l/5c3cffd56a89478896884a785dfd2784 2023-07-22 00:09:04,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c3cffd56a89478896884a785dfd2784 2023-07-22 00:09:04,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/.tmp/l/5c3cffd56a89478896884a785dfd2784 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/l/5c3cffd56a89478896884a785dfd2784 2023-07-22 00:09:04,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c3cffd56a89478896884a785dfd2784 2023-07-22 00:09:04,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/l/5c3cffd56a89478896884a785dfd2784, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 00:09:04,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 875272fc4f8e08f07ac8c0249092d9eb in 23ms, sequenceid=18, compaction requested=false 2023-07-22 00:09:04,983 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:04,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/table/c377bc8237c245f183d7bec7baee3143 2023-07-22 00:09:04,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c377bc8237c245f183d7bec7baee3143 2023-07-22 00:09:04,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/info/a3a2b0e7fcb74eb78b4cb17a7d7826a8 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/info/a3a2b0e7fcb74eb78b4cb17a7d7826a8 2023-07-22 00:09:04,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3a2b0e7fcb74eb78b4cb17a7d7826a8 2023-07-22 00:09:04,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/info/a3a2b0e7fcb74eb78b4cb17a7d7826a8, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 00:09:04,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/acl/875272fc4f8e08f07ac8c0249092d9eb/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 00:09:04,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/rep_barrier/d82c23cb24084749a2adc62f1012d138 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/rep_barrier/d82c23cb24084749a2adc62f1012d138 2023-07-22 00:09:04,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:09:05,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 875272fc4f8e08f07ac8c0249092d9eb: 2023-07-22 00:09:05,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689984383358.875272fc4f8e08f07ac8c0249092d9eb. 2023-07-22 00:09:05,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d82c23cb24084749a2adc62f1012d138 2023-07-22 00:09:05,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/rep_barrier/d82c23cb24084749a2adc62f1012d138, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 00:09:05,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/.tmp/table/c377bc8237c245f183d7bec7baee3143 as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/table/c377bc8237c245f183d7bec7baee3143 2023-07-22 00:09:05,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c377bc8237c245f183d7bec7baee3143 2023-07-22 00:09:05,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/table/c377bc8237c245f183d7bec7baee3143, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 00:09:05,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=131, compaction requested=false 2023-07-22 00:09:05,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 00:09:05,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 00:09:05,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 00:09:05,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 00:09:05,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 00:09:05,048 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,048 INFO [RS:2;jenkins-hbase4:45387] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45387,1689984379695; zookeeper connection closed. 2023-07-22 00:09:05,048 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:45387-0x1018a59a4790003, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,048 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a53d3c4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a53d3c4 2023-07-22 00:09:05,105 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37101,1689984379582; all regions closed. 2023-07-22 00:09:05,110 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40135,1689984379650; all regions closed. 2023-07-22 00:09:05,118 DEBUG [RS:0;jenkins-hbase4:37101] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs 2023-07-22 00:09:05,118 INFO [RS:0;jenkins-hbase4:37101] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37101%2C1689984379582:(num 1689984381846) 2023-07-22 00:09:05,119 DEBUG [RS:0;jenkins-hbase4:37101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,119 INFO [RS:0;jenkins-hbase4:37101] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,119 INFO [RS:0;jenkins-hbase4:37101] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:05,120 INFO [RS:0;jenkins-hbase4:37101] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:05,120 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,120 INFO [RS:0;jenkins-hbase4:37101] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:05,121 DEBUG [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs 2023-07-22 00:09:05,121 INFO [RS:0;jenkins-hbase4:37101] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:05,121 INFO [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40135%2C1689984379650.meta:.meta(num 1689984382218) 2023-07-22 00:09:05,122 INFO [RS:0;jenkins-hbase4:37101] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37101 2023-07-22 00:09:05,128 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,128 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:09:05,128 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37101,1689984379582 2023-07-22 00:09:05,131 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37101,1689984379582] 2023-07-22 00:09:05,131 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37101,1689984379582; numProcessing=2 2023-07-22 00:09:05,132 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37101,1689984379582 already deleted, retry=false 2023-07-22 00:09:05,132 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37101,1689984379582 expired; onlineServers=1 2023-07-22 00:09:05,141 DEBUG [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/oldWALs 2023-07-22 00:09:05,141 INFO [RS:1;jenkins-hbase4:40135] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40135%2C1689984379650:(num 1689984381888) 2023-07-22 00:09:05,141 DEBUG [RS:1;jenkins-hbase4:40135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,141 INFO [RS:1;jenkins-hbase4:40135] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,141 INFO [RS:1;jenkins-hbase4:40135] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:05,141 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,142 INFO [RS:1;jenkins-hbase4:40135] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40135 2023-07-22 00:09:05,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,145 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40135,1689984379650 2023-07-22 00:09:05,146 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40135,1689984379650] 2023-07-22 00:09:05,146 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40135,1689984379650; numProcessing=3 2023-07-22 00:09:05,147 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40135,1689984379650 already deleted, retry=false 2023-07-22 00:09:05,148 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40135,1689984379650 expired; onlineServers=0 2023-07-22 00:09:05,148 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34721,1689984378142' ***** 2023-07-22 00:09:05,148 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 00:09:05,148 DEBUG [M:0;jenkins-hbase4:34721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66234e8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:09:05,148 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34721,1689984378142 2023-07-22 00:09:05,148 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34721,1689984378142; all regions closed. 2023-07-22 00:09:05,148 DEBUG [M:0;jenkins-hbase4:34721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,148 DEBUG [M:0;jenkins-hbase4:34721] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 00:09:05,148 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 00:09:05,148 DEBUG [M:0;jenkins-hbase4:34721] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 00:09:05,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381351] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381351,5,FailOnTimeoutGroup] 2023-07-22 00:09:05,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381365] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381365,5,FailOnTimeoutGroup] 2023-07-22 00:09:05,149 INFO [M:0;jenkins-hbase4:34721] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 00:09:05,149 INFO [M:0;jenkins-hbase4:34721] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 00:09:05,149 INFO [M:0;jenkins-hbase4:34721] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 00:09:05,149 DEBUG [M:0;jenkins-hbase4:34721] master.HMaster(1512): Stopping service threads 2023-07-22 00:09:05,150 INFO [M:0;jenkins-hbase4:34721] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 00:09:05,151 ERROR [M:0;jenkins-hbase4:34721] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 00:09:05,152 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 00:09:05,152 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:09:05,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:09:05,156 INFO [M:0;jenkins-hbase4:34721] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 00:09:05,156 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 00:09:05,156 DEBUG [M:0;jenkins-hbase4:34721] zookeeper.ZKUtil(398): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 00:09:05,157 WARN [M:0;jenkins-hbase4:34721] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 00:09:05,157 INFO [M:0;jenkins-hbase4:34721] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 00:09:05,157 INFO [M:0;jenkins-hbase4:34721] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 00:09:05,158 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 00:09:05,158 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:05,158 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:05,158 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 00:09:05,158 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:05,158 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=451.94 KB 2023-07-22 00:09:05,185 INFO [M:0;jenkins-hbase4:34721] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6871aa174a9b4749be783d82493f760f 2023-07-22 00:09:05,190 INFO [M:0;jenkins-hbase4:34721] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6871aa174a9b4749be783d82493f760f 2023-07-22 00:09:05,191 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6871aa174a9b4749be783d82493f760f as hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6871aa174a9b4749be783d82493f760f 2023-07-22 00:09:05,196 INFO [M:0;jenkins-hbase4:34721] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6871aa174a9b4749be783d82493f760f 2023-07-22 00:09:05,197 INFO [M:0;jenkins-hbase4:34721] regionserver.HStore(1080): Added hdfs://localhost:35929/user/jenkins/test-data/8c8467ae-c0aa-b453-f83c-197798284b12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6871aa174a9b4749be783d82493f760f, entries=119, sequenceid=899, filesize=28.6 K 2023-07-22 00:09:05,198 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384699, heapSize ~451.92 KB/462768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 40ms, sequenceid=899, compaction requested=false 2023-07-22 00:09:05,202 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:05,203 DEBUG [M:0;jenkins-hbase4:34721] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:09:05,211 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,211 INFO [M:0;jenkins-hbase4:34721] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 00:09:05,212 INFO [M:0;jenkins-hbase4:34721] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34721 2023-07-22 00:09:05,220 DEBUG [M:0;jenkins-hbase4:34721] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34721,1689984378142 already deleted, retry=false 2023-07-22 00:09:05,232 INFO [RS:0;jenkins-hbase4:37101] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37101,1689984379582; zookeeper connection closed. 2023-07-22 00:09:05,232 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,232 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:37101-0x1018a59a4790001, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,233 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@410b2d80] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@410b2d80 2023-07-22 00:09:05,332 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,332 INFO [M:0;jenkins-hbase4:34721] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34721,1689984378142; zookeeper connection closed. 2023-07-22 00:09:05,332 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): master:34721-0x1018a59a4790000, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,432 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,432 INFO [RS:1;jenkins-hbase4:40135] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40135,1689984379650; zookeeper connection closed. 2023-07-22 00:09:05,432 DEBUG [Listener at localhost/40587-EventThread] zookeeper.ZKWatcher(600): regionserver:40135-0x1018a59a4790002, quorum=127.0.0.1:55465, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,432 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b39db3c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b39db3c 2023-07-22 00:09:05,433 INFO [Listener at jenkins-hbase4.apache.org/36243] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 00:09:05,433 WARN [Listener at jenkins-hbase4.apache.org/36243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:05,438 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:05,541 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:05,541 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1742416163-172.31.14.131-1689984374151 (Datanode Uuid 457ced63-5212-43dc-b2ae-5c8b38a67f3a) service to localhost/127.0.0.1:35929 2023-07-22 00:09:05,543 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data5/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,543 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data6/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,544 WARN [Listener at jenkins-hbase4.apache.org/36243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:05,550 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:05,654 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:05,654 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1742416163-172.31.14.131-1689984374151 (Datanode Uuid e27027df-ceb6-41aa-b614-06af873112c1) service to localhost/127.0.0.1:35929 2023-07-22 00:09:05,654 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data3/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data4/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,656 WARN [Listener at jenkins-hbase4.apache.org/36243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:05,658 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:05,762 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:05,762 WARN [BP-1742416163-172.31.14.131-1689984374151 heartbeating to localhost/127.0.0.1:35929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1742416163-172.31.14.131-1689984374151 (Datanode Uuid 23f9e004-773f-4725-be85-3ae382f50c39) service to localhost/127.0.0.1:35929 2023-07-22 00:09:05,763 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data1/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,763 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/54d56f88-d6cc-d4b7-88da-dbd169d7bf2f/cluster_68f47bdd-0ab1-796b-f001-860609ce33b3/dfs/data/data2/current/BP-1742416163-172.31.14.131-1689984374151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:05,792 INFO [Listener at jenkins-hbase4.apache.org/36243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:05,921 INFO [Listener at jenkins-hbase4.apache.org/36243] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 00:09:06,008 INFO [Listener at jenkins-hbase4.apache.org/36243] hbase.HBaseTestingUtility(1293): Minicluster is down