2023-07-13 23:11:24,411 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-13 23:11:24,686 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36 2023-07-13 23:11:24,686 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-13 23:11:24,738 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-13 23:11:25,028 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-13 23:11:25,028 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e, deleteOnExit=true 2023-07-13 23:11:25,029 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-13 23:11:25,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/test.cache.data in system properties and HBase conf 2023-07-13 23:11:25,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 23:11:25,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop.log.dir in system properties and HBase conf 2023-07-13 23:11:25,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 23:11:25,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 23:11:25,032 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 23:11:25,459 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-13 23:11:25,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:25,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:25,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 23:11:25,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:25,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 23:11:25,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 23:11:25,466 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:25,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:25,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 23:11:25,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/nfs.dump.dir in system properties and HBase conf 2023-07-13 23:11:25,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir in system properties and HBase conf 2023-07-13 23:11:25,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:25,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 23:11:25,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-13 23:11:26,127 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 23:11:26,133 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 23:11:26,476 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-13 23:11:26,694 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-13 23:11:26,707 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:26,751 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:26,797 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_localhost_36315_hdfs____xfyltq/webapp 2023-07-13 23:11:26,987 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36315 2023-07-13 23:11:27,001 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 23:11:27,001 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 23:11:27,631 WARN [Listener at localhost/44557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:27,784 WARN [Listener at localhost/44557] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:27,881 WARN [Listener at localhost/44557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:27,890 INFO [Listener at localhost/44557] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:27,900 INFO [Listener at localhost/44557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_localhost_46549_datanode____a0wvbz/webapp 2023-07-13 23:11:28,019 INFO [Listener at localhost/44557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46549 2023-07-13 23:11:28,487 WARN [Listener at localhost/46109] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:28,533 WARN [Listener at localhost/46109] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:28,540 WARN [Listener at localhost/46109] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:28,543 INFO [Listener at localhost/46109] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:28,553 INFO [Listener at localhost/46109] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_localhost_34023_datanode____.39gvjd/webapp 2023-07-13 23:11:28,743 INFO [Listener at localhost/46109] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34023 2023-07-13 23:11:28,754 WARN [Listener at localhost/36635] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:28,778 WARN [Listener at localhost/36635] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 23:11:28,781 WARN [Listener at localhost/36635] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:28,783 INFO [Listener at localhost/36635] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:28,796 INFO [Listener at localhost/36635] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_localhost_36355_datanode____juxdbr/webapp 2023-07-13 23:11:28,999 INFO [Listener at localhost/36635] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36355 2023-07-13 23:11:29,044 WARN [Listener at localhost/33781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 23:11:29,307 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d02aba33c065c: Processing first storage report for DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b from datanode 712f1a86-778d-46d5-9ce3-138d53674a56 2023-07-13 23:11:29,309 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d02aba33c065c: from storage DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b node DatanodeRegistration(127.0.0.1:33011, datanodeUuid=712f1a86-778d-46d5-9ce3-138d53674a56, infoPort=40675, infoSecurePort=0, ipcPort=46109, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,309 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73fe26ce5f8baeef: Processing first storage report for DS-271f272f-2916-43db-a62b-2be57b73fbf9 from datanode fbfbd7a2-bfb8-451b-9a7f-63d0ef674861 2023-07-13 23:11:29,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73fe26ce5f8baeef: from storage DS-271f272f-2916-43db-a62b-2be57b73fbf9 node DatanodeRegistration(127.0.0.1:38167, datanodeUuid=fbfbd7a2-bfb8-451b-9a7f-63d0ef674861, infoPort=34371, infoSecurePort=0, ipcPort=36635, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf917d02f27d8a93a: Processing first storage report for DS-6b2b44bb-697c-471f-b72f-a7328aff59c9 from datanode e5aca8c7-38c6-4821-9a4e-fc8c7da66b61 2023-07-13 23:11:29,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf917d02f27d8a93a: from storage DS-6b2b44bb-697c-471f-b72f-a7328aff59c9 node DatanodeRegistration(127.0.0.1:41551, datanodeUuid=e5aca8c7-38c6-4821-9a4e-fc8c7da66b61, infoPort=36109, infoSecurePort=0, ipcPort=33781, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d02aba33c065c: Processing first storage report for DS-1a5f4098-29d0-45dc-ac9e-43900d1c88b0 from datanode 712f1a86-778d-46d5-9ce3-138d53674a56 2023-07-13 23:11:29,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d02aba33c065c: from storage DS-1a5f4098-29d0-45dc-ac9e-43900d1c88b0 node DatanodeRegistration(127.0.0.1:33011, datanodeUuid=712f1a86-778d-46d5-9ce3-138d53674a56, infoPort=40675, infoSecurePort=0, ipcPort=46109, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,311 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73fe26ce5f8baeef: Processing first storage report for DS-e25966ef-9e1b-45db-939e-8d3fb27b6759 from datanode fbfbd7a2-bfb8-451b-9a7f-63d0ef674861 2023-07-13 23:11:29,311 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73fe26ce5f8baeef: from storage DS-e25966ef-9e1b-45db-939e-8d3fb27b6759 node DatanodeRegistration(127.0.0.1:38167, datanodeUuid=fbfbd7a2-bfb8-451b-9a7f-63d0ef674861, infoPort=34371, infoSecurePort=0, ipcPort=36635, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,311 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf917d02f27d8a93a: Processing first storage report for DS-6cc38935-7cc1-4ad7-86f5-ba2626789837 from datanode e5aca8c7-38c6-4821-9a4e-fc8c7da66b61 2023-07-13 23:11:29,311 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf917d02f27d8a93a: from storage DS-6cc38935-7cc1-4ad7-86f5-ba2626789837 node DatanodeRegistration(127.0.0.1:41551, datanodeUuid=e5aca8c7-38c6-4821-9a4e-fc8c7da66b61, infoPort=36109, infoSecurePort=0, ipcPort=33781, storageInfo=lv=-57;cid=testClusterID;nsid=1762447228;c=1689289886230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 23:11:29,598 DEBUG [Listener at localhost/33781] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36 2023-07-13 23:11:29,699 INFO [Listener at localhost/33781] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/zookeeper_0, clientPort=63267, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-13 23:11:29,729 INFO [Listener at localhost/33781] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63267 2023-07-13 23:11:29,739 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:29,743 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:30,463 INFO [Listener at localhost/33781] util.FSUtils(471): Created version file at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d with version=8 2023-07-13 23:11:30,463 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/hbase-staging 2023-07-13 23:11:30,861 INFO [Listener at localhost/33781] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-13 23:11:31,517 INFO [Listener at localhost/33781] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:31,552 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,553 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,553 INFO [Listener at localhost/33781] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:31,553 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:31,554 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:31,722 INFO [Listener at localhost/33781] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:31,810 DEBUG [Listener at localhost/33781] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-13 23:11:31,912 INFO [Listener at localhost/33781] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39197 2023-07-13 23:11:31,928 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:31,931 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:31,962 INFO [Listener at localhost/33781] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39197 connecting to ZooKeeper ensemble=127.0.0.1:63267 2023-07-13 23:11:32,058 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:391970x0, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39197-0x10160f49a8f0000 connected 2023-07-13 23:11:32,100 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,101 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,116 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,124 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39197 2023-07-13 23:11:32,125 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39197 2023-07-13 23:11:32,127 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39197 2023-07-13 23:11:32,128 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39197 2023-07-13 23:11:32,129 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39197 2023-07-13 23:11:32,136 INFO [Listener at localhost/33781] master.HMaster(444): hbase.rootdir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, hbase.cluster.distributed=false 2023-07-13 23:11:32,208 INFO [Listener at localhost/33781] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,209 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,209 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,210 INFO [Listener at localhost/33781] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,211 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,211 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,218 INFO [Listener at localhost/33781] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,221 INFO [Listener at localhost/33781] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41069 2023-07-13 23:11:32,224 INFO [Listener at localhost/33781] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,246 DEBUG [Listener at localhost/33781] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 23:11:32,248 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,251 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,255 INFO [Listener at localhost/33781] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41069 connecting to ZooKeeper ensemble=127.0.0.1:63267 2023-07-13 23:11:32,268 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:410690x0, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,270 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:410690x0, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41069-0x10160f49a8f0001 connected 2023-07-13 23:11:32,271 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,272 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,278 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-13 23:11:32,279 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41069 2023-07-13 23:11:32,283 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41069 2023-07-13 23:11:32,284 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-13 23:11:32,284 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-13 23:11:32,302 INFO [Listener at localhost/33781] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,303 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,303 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,303 INFO [Listener at localhost/33781] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,304 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,306 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,306 INFO [Listener at localhost/33781] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,308 INFO [Listener at localhost/33781] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45125 2023-07-13 23:11:32,308 INFO [Listener at localhost/33781] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,314 DEBUG [Listener at localhost/33781] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 23:11:32,315 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,317 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,320 INFO [Listener at localhost/33781] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45125 connecting to ZooKeeper ensemble=127.0.0.1:63267 2023-07-13 23:11:32,328 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:451250x0, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,330 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:451250x0, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45125-0x10160f49a8f0002 connected 2023-07-13 23:11:32,332 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,333 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,334 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45125 2023-07-13 23:11:32,335 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45125 2023-07-13 23:11:32,336 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45125 2023-07-13 23:11:32,339 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45125 2023-07-13 23:11:32,342 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45125 2023-07-13 23:11:32,359 INFO [Listener at localhost/33781] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 23:11:32,360 INFO [Listener at localhost/33781] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 23:11:32,362 INFO [Listener at localhost/33781] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40551 2023-07-13 23:11:32,363 INFO [Listener at localhost/33781] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 23:11:32,369 DEBUG [Listener at localhost/33781] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-13 23:11:32,371 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,374 INFO [Listener at localhost/33781] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,376 INFO [Listener at localhost/33781] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40551 connecting to ZooKeeper ensemble=127.0.0.1:63267 2023-07-13 23:11:32,383 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:405510x0, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 23:11:32,384 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:405510x0, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:11:32,384 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:405510x0, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:11:32,385 DEBUG [Listener at localhost/33781] zookeeper.ZKUtil(164): regionserver:405510x0, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 23:11:32,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40551-0x10160f49a8f0003 connected 2023-07-13 23:11:32,390 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40551 2023-07-13 23:11:32,390 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40551 2023-07-13 23:11:32,391 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40551 2023-07-13 23:11:32,395 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40551 2023-07-13 23:11:32,395 DEBUG [Listener at localhost/33781] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40551 2023-07-13 23:11:32,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:32,410 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 23:11:32,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:32,434 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,434 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,434 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,434 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 23:11:32,435 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:32,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 23:11:32,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 23:11:32,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39197,1689289890670 from backup master directory 2023-07-13 23:11:32,444 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:32,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 23:11:32,446 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:32,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:32,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-13 23:11:32,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-13 23:11:32,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/hbase.id with ID: 6d4a2bd7-3f40-4fa0-9bc2-1f3df81060af 2023-07-13 23:11:32,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 23:11:32,696 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:32,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1a466276 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:32,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a55a74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:32,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:32,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-13 23:11:32,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-13 23:11:32,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-13 23:11:32,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:32,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:32,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:32,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store-tmp 2023-07-13 23:11:32,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:32,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 23:11:32,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 23:11:32,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:11:32,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:11:32,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/WALs/jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:32,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39197%2C1689289890670, suffix=, logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/WALs/jenkins-hbase4.apache.org,39197,1689289890670, archiveDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/oldWALs, maxLogs=10 2023-07-13 23:11:33,079 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK] 2023-07-13 23:11:33,072 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK] 2023-07-13 23:11:33,079 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK] 2023-07-13 23:11:33,088 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-13 23:11:33,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/WALs/jenkins-hbase4.apache.org,39197,1689289890670/jenkins-hbase4.apache.org%2C39197%2C1689289890670.1689289893009 2023-07-13 23:11:33,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK], DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK], DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK]] 2023-07-13 23:11:33,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:33,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:33,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,294 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,301 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-13 23:11:33,336 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-13 23:11:33,350 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:33,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 23:11:33,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:33,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74959244, jitterRate=0.11697977781295776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:33,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:11:33,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-13 23:11:33,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-13 23:11:33,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-13 23:11:33,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-13 23:11:33,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-13 23:11:33,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-07-13 23:11:33,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-13 23:11:33,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-13 23:11:33,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-13 23:11:33,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-13 23:11:33,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-13 23:11:33,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-13 23:11:33,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-13 23:11:33,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-13 23:11:33,527 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-13 23:11:33,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-13 23:11:33,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-13 23:11:33,559 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,559 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,560 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,559 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 23:11:33,560 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39197,1689289890670, sessionid=0x10160f49a8f0000, setting cluster-up flag (Was=false) 2023-07-13 23:11:33,586 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-13 23:11:33,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:33,610 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:33,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-13 23:11:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:33,622 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp 2023-07-13 23:11:33,710 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(951): ClusterId : 6d4a2bd7-3f40-4fa0-9bc2-1f3df81060af 2023-07-13 23:11:33,725 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,727 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(951): ClusterId : 6d4a2bd7-3f40-4fa0-9bc2-1f3df81060af 2023-07-13 23:11:33,730 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,734 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(951): ClusterId : 6d4a2bd7-3f40-4fa0-9bc2-1f3df81060af 2023-07-13 23:11:33,737 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 23:11:33,742 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,742 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,743 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,743 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,746 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 23:11:33,746 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 23:11:33,749 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,749 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,754 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 23:11:33,754 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ReadOnlyZKClient(139): Connect 0x774278ee to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,757 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ReadOnlyZKClient(139): Connect 0x5366c819 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,775 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ReadOnlyZKClient(139): Connect 0x7dd64846 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:33,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-13 23:11:33,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-13 23:11:33,815 DEBUG [RS:1;jenkins-hbase4:45125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5da13c05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,817 DEBUG [RS:1;jenkins-hbase4:45125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ea369, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,822 DEBUG [RS:2;jenkins-hbase4:40551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7311b98c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,823 DEBUG [RS:2;jenkins-hbase4:40551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@772e2336, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,843 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79858876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:33,844 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38b8824d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:11:33,875 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41069 2023-07-13 23:11:33,877 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45125 2023-07-13 23:11:33,882 INFO [RS:0;jenkins-hbase4:41069] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,883 INFO [RS:0;jenkins-hbase4:41069] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,883 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,886 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40551 2023-07-13 23:11:33,886 INFO [RS:2;jenkins-hbase4:40551] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,886 INFO [RS:2;jenkins-hbase4:40551] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,886 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,882 INFO [RS:1;jenkins-hbase4:45125] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 23:11:33,891 INFO [RS:0;jenkins-hbase4:41069] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,887 INFO [RS:2;jenkins-hbase4:40551] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,893 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,893 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,893 INFO [RS:1;jenkins-hbase4:45125] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 23:11:33,894 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 23:11:33,894 INFO [RS:1;jenkins-hbase4:45125] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:33,894 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 23:11:33,902 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:40551, startcode=1689289892359 2023-07-13 23:11:33,903 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:41069, startcode=1689289892207 2023-07-13 23:11:33,903 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:45125, startcode=1689289892301 2023-07-13 23:11:33,934 DEBUG [RS:2;jenkins-hbase4:40551] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:33,934 DEBUG [RS:0;jenkins-hbase4:41069] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:33,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:33,940 DEBUG [RS:1;jenkins-hbase4:45125] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 23:11:33,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:33,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:33,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:33,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689289923976 2023-07-13 23:11:33,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-13 23:11:34,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-13 23:11:34,011 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:34,012 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-13 23:11:34,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-13 23:11:34,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-13 23:11:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-13 23:11:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-13 23:11:34,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,019 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:34,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-13 23:11:34,027 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51965, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,031 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60209, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,032 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55255, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 23:11:34,043 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-13 23:11:34,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-13 23:11:34,056 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,061 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 23:11:34,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-13 23:11:34,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-13 23:11:34,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894075,5,FailOnTimeoutGroup] 2023-07-13 23:11:34,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894083,5,FailOnTimeoutGroup] 2023-07-13 23:11:34,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-13 23:11:34,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,141 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,142 WARN [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,142 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,142 WARN [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,141 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 23:11:34,144 WARN [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 23:11:34,176 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:34,177 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:34,178 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:34,220 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:34,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 23:11:34,232 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/info 2023-07-13 23:11:34,233 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 23:11:34,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 23:11:34,243 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:45125, startcode=1689289892301 2023-07-13 23:11:34,244 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:34,245 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:40551, startcode=1689289892359 2023-07-13 23:11:34,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 23:11:34,246 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39197,1689289890670 with isa=jenkins-hbase4.apache.org/172.31.14.131:41069, startcode=1689289892207 2023-07-13 23:11:34,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,253 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 23:11:34,257 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/table 2023-07-13 23:11:34,257 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 23:11:34,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,260 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740 2023-07-13 23:11:34,263 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740 2023-07-13 23:11:34,263 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,265 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:34,265 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44557 2023-07-13 23:11:34,265 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,266 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39197] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,268 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:34,268 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44557 2023-07-13 23:11:34,268 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,273 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 23:11:34,269 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:34,280 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44557 2023-07-13 23:11:34,280 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 23:11:34,282 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 23:11:34,288 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:11:34,289 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,289 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,289 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ZKUtil(162): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,289 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:34,289 WARN [RS:2;jenkins-hbase4:40551] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,289 WARN [RS:0;jenkins-hbase4:41069] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,298 INFO [RS:2;jenkins-hbase4:40551] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,290 WARN [RS:1;jenkins-hbase4:45125] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 23:11:34,299 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,301 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64394318, jitterRate=-0.04044988751411438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 23:11:34,301 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 23:11:34,301 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 23:11:34,301 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 23:11:34,301 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45125,1689289892301] 2023-07-13 23:11:34,301 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41069,1689289892207] 2023-07-13 23:11:34,301 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40551,1689289892359] 2023-07-13 23:11:34,301 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 23:11:34,301 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 23:11:34,301 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 23:11:34,298 INFO [RS:0;jenkins-hbase4:41069] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,299 INFO [RS:1;jenkins-hbase4:45125] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,303 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,303 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,322 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 23:11:34,325 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 23:11:34,333 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 23:11:34,333 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-13 23:11:34,337 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ZKUtil(162): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,337 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,337 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,338 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,338 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ZKUtil(162): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,338 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,339 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ZKUtil(162): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,340 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ZKUtil(162): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,340 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-13 23:11:34,356 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,356 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,357 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 23:11:34,370 INFO [RS:0;jenkins-hbase4:41069] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,371 INFO [RS:1;jenkins-hbase4:45125] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,371 INFO [RS:2;jenkins-hbase4:40551] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 23:11:34,372 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-13 23:11:34,375 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-13 23:11:34,400 INFO [RS:1;jenkins-hbase4:45125] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,413 INFO [RS:1;jenkins-hbase4:45125] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,413 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,414 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,403 INFO [RS:2;jenkins-hbase4:40551] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,421 INFO [RS:0;jenkins-hbase4:41069] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 23:11:34,422 INFO [RS:2;jenkins-hbase4:40551] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,423 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,424 INFO [RS:0;jenkins-hbase4:41069] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 23:11:34,424 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,424 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,426 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 23:11:34,431 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,431 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,431 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,431 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,432 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,432 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,432 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,432 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,432 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,433 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,433 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,433 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,433 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,434 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,441 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,442 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,442 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,442 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:1;jenkins-hbase4:45125] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,443 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,444 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,444 DEBUG [RS:2;jenkins-hbase4:40551] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-13 23:11:34,451 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,451 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,451 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,466 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,467 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,467 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,469 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,469 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,469 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,472 INFO [RS:0;jenkins-hbase4:41069] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,475 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41069,1689289892207-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,487 INFO [RS:2;jenkins-hbase4:40551] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,488 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40551,1689289892359-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,501 INFO [RS:1;jenkins-hbase4:45125] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 23:11:34,501 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45125,1689289892301-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:34,521 INFO [RS:0;jenkins-hbase4:41069] regionserver.Replication(203): jenkins-hbase4.apache.org,41069,1689289892207 started 2023-07-13 23:11:34,521 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41069,1689289892207, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41069, sessionid=0x10160f49a8f0001 2023-07-13 23:11:34,522 INFO [RS:2;jenkins-hbase4:40551] regionserver.Replication(203): jenkins-hbase4.apache.org,40551,1689289892359 started 2023-07-13 23:11:34,522 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,522 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40551,1689289892359, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40551, sessionid=0x10160f49a8f0003 2023-07-13 23:11:34,522 DEBUG [RS:0;jenkins-hbase4:41069] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,522 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,522 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41069,1689289892207' 2023-07-13 23:11:34,522 DEBUG [RS:2;jenkins-hbase4:40551] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,523 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,523 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40551,1689289892359' 2023-07-13 23:11:34,524 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,525 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,525 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,525 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,525 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,526 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,526 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,526 DEBUG [RS:0;jenkins-hbase4:41069] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:34,526 DEBUG [RS:2;jenkins-hbase4:40551] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:34,534 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41069,1689289892207' 2023-07-13 23:11:34,534 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,530 DEBUG [jenkins-hbase4:39197] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-13 23:11:34,534 INFO [RS:1;jenkins-hbase4:45125] regionserver.Replication(203): jenkins-hbase4.apache.org,45125,1689289892301 started 2023-07-13 23:11:34,534 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40551,1689289892359' 2023-07-13 23:11:34,536 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45125,1689289892301, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45125, sessionid=0x10160f49a8f0002 2023-07-13 23:11:34,536 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,536 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 23:11:34,536 DEBUG [RS:1;jenkins-hbase4:45125] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,536 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45125,1689289892301' 2023-07-13 23:11:34,536 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 23:11:34,536 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,537 DEBUG [RS:2;jenkins-hbase4:40551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,537 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 23:11:34,537 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,537 INFO [RS:0;jenkins-hbase4:41069] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,537 INFO [RS:0;jenkins-hbase4:41069] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,537 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 23:11:34,537 DEBUG [RS:2;jenkins-hbase4:40551] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,538 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 23:11:34,538 DEBUG [RS:1;jenkins-hbase4:45125] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,538 INFO [RS:2;jenkins-hbase4:40551] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,538 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45125,1689289892301' 2023-07-13 23:11:34,539 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:34,538 INFO [RS:2;jenkins-hbase4:40551] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,541 DEBUG [RS:1;jenkins-hbase4:45125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:34,541 DEBUG [jenkins-hbase4:39197] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:34,542 DEBUG [RS:1;jenkins-hbase4:45125] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 23:11:34,542 INFO [RS:1;jenkins-hbase4:45125] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 23:11:34,542 INFO [RS:1;jenkins-hbase4:45125] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 23:11:34,549 DEBUG [jenkins-hbase4:39197] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:34,549 DEBUG [jenkins-hbase4:39197] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:34,549 DEBUG [jenkins-hbase4:39197] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:34,549 DEBUG [jenkins-hbase4:39197] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:34,553 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45125,1689289892301, state=OPENING 2023-07-13 23:11:34,564 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-13 23:11:34,567 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:34,568 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 23:11:34,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:11:34,650 INFO [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45125%2C1689289892301, suffix=, logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,45125,1689289892301, archiveDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs, maxLogs=32 2023-07-13 23:11:34,650 INFO [RS:2;jenkins-hbase4:40551] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40551%2C1689289892359, suffix=, logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,40551,1689289892359, archiveDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs, maxLogs=32 2023-07-13 23:11:34,650 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41069%2C1689289892207, suffix=, logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,41069,1689289892207, archiveDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs, maxLogs=32 2023-07-13 23:11:34,689 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK] 2023-07-13 23:11:34,689 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK] 2023-07-13 23:11:34,689 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK] 2023-07-13 23:11:34,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK] 2023-07-13 23:11:34,690 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK] 2023-07-13 23:11:34,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK] 2023-07-13 23:11:34,690 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK] 2023-07-13 23:11:34,691 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK] 2023-07-13 23:11:34,691 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK] 2023-07-13 23:11:34,719 INFO [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,45125,1689289892301/jenkins-hbase4.apache.org%2C45125%2C1689289892301.1689289894656 2023-07-13 23:11:34,723 DEBUG [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK], DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK], DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK]] 2023-07-13 23:11:34,725 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,41069,1689289892207/jenkins-hbase4.apache.org%2C41069%2C1689289892207.1689289894656 2023-07-13 23:11:34,726 INFO [RS:2;jenkins-hbase4:40551] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,40551,1689289892359/jenkins-hbase4.apache.org%2C40551%2C1689289892359.1689289894656 2023-07-13 23:11:34,728 DEBUG [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK], DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK], DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK]] 2023-07-13 23:11:34,728 DEBUG [RS:2;jenkins-hbase4:40551] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK], DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK], DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK]] 2023-07-13 23:11:34,803 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:34,807 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:34,816 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:34,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-13 23:11:34,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 23:11:34,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45125%2C1689289892301.meta, suffix=.meta, logDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,45125,1689289892301, archiveDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs, maxLogs=32 2023-07-13 23:11:34,862 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK] 2023-07-13 23:11:34,863 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK] 2023-07-13 23:11:34,871 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK] 2023-07-13 23:11:34,875 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/WALs/jenkins-hbase4.apache.org,45125,1689289892301/jenkins-hbase4.apache.org%2C45125%2C1689289892301.meta.1689289894837.meta 2023-07-13 23:11:34,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38167,DS-271f272f-2916-43db-a62b-2be57b73fbf9,DISK], DatanodeInfoWithStorage[127.0.0.1:33011,DS-cb4718f4-5b32-498e-b87b-9ad6fe545c4b,DISK], DatanodeInfoWithStorage[127.0.0.1:41551,DS-6b2b44bb-697c-471f-b72f-a7328aff59c9,DISK]] 2023-07-13 23:11:34,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:34,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-13 23:11:34,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:34,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-13 23:11:34,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-13 23:11:34,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-13 23:11:34,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-13 23:11:34,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:34,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-13 23:11:34,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-13 23:11:34,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 23:11:34,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/info 2023-07-13 23:11:34,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/info 2023-07-13 23:11:34,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 23:11:34,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 23:11:34,910 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:34,910 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/rep_barrier 2023-07-13 23:11:34,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 23:11:34,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 23:11:34,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/table 2023-07-13 23:11:34,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/table 2023-07-13 23:11:34,914 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 23:11:34,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:34,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740 2023-07-13 23:11:34,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740 2023-07-13 23:11:34,933 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 23:11:34,936 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 23:11:34,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70672281, jitterRate=0.053099051117897034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 23:11:34,942 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 23:11:34,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689289894792 2023-07-13 23:11:34,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-13 23:11:34,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-13 23:11:34,987 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45125,1689289892301, state=OPEN 2023-07-13 23:11:34,991 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-13 23:11:34,991 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 23:11:35,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-13 23:11:35,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45125,1689289892301 in 395 msec 2023-07-13 23:11:35,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-13 23:11:35,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 655 msec 2023-07-13 23:11:35,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2230 sec 2023-07-13 23:11:35,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689289895021, completionTime=-1 2023-07-13 23:11:35,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-13 23:11:35,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-13 23:11:35,110 DEBUG [hconnection-0x31c1ae37-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:35,114 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:35,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-13 23:11:35,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689289955145 2023-07-13 23:11:35,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689290015145 2023-07-13 23:11:35,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-07-13 23:11:35,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39197,1689289890670-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39197,1689289890670-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39197,1689289890670-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39197, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-13 23:11:35,207 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-13 23:11:35,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-13 23:11:35,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:35,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-13 23:11:35,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:35,234 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:35,267 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,273 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba empty. 2023-07-13 23:11:35,274 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,274 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-13 23:11:35,343 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:35,345 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7034d5b2c08dbe7b30da55189a3347ba, NAME => 'hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:11:35,375 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:35,375 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7034d5b2c08dbe7b30da55189a3347ba, disabling compactions & flushes 2023-07-13 23:11:35,375 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,375 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,376 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. after waiting 0 ms 2023-07-13 23:11:35,376 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,376 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,376 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7034d5b2c08dbe7b30da55189a3347ba: 2023-07-13 23:11:35,381 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:35,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289895383"}]},"ts":"1689289895383"} 2023-07-13 23:11:35,431 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 23:11:35,433 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:35,439 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289895433"}]},"ts":"1689289895433"} 2023-07-13 23:11:35,450 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-13 23:11:35,455 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:35,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:35,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:35,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:35,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:35,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7034d5b2c08dbe7b30da55189a3347ba, ASSIGN}] 2023-07-13 23:11:35,463 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7034d5b2c08dbe7b30da55189a3347ba, ASSIGN 2023-07-13 23:11:35,465 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7034d5b2c08dbe7b30da55189a3347ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689289892207; forceNewPlan=false, retain=false 2023-07-13 23:11:35,617 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:11:35,618 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7034d5b2c08dbe7b30da55189a3347ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:35,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289895618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289895618"}]},"ts":"1689289895618"} 2023-07-13 23:11:35,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7034d5b2c08dbe7b30da55189a3347ba, server=jenkins-hbase4.apache.org,41069,1689289892207}] 2023-07-13 23:11:35,777 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:35,777 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:35,780 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:35,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7034d5b2c08dbe7b30da55189a3347ba, NAME => 'hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:35,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. service=AccessControlService 2023-07-13 23:11:35,788 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:35,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:35,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,791 INFO [StoreOpener-7034d5b2c08dbe7b30da55189a3347ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,793 DEBUG [StoreOpener-7034d5b2c08dbe7b30da55189a3347ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/info 2023-07-13 23:11:35,793 DEBUG [StoreOpener-7034d5b2c08dbe7b30da55189a3347ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/info 2023-07-13 23:11:35,794 INFO [StoreOpener-7034d5b2c08dbe7b30da55189a3347ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7034d5b2c08dbe7b30da55189a3347ba columnFamilyName info 2023-07-13 23:11:35,795 INFO [StoreOpener-7034d5b2c08dbe7b30da55189a3347ba-1] regionserver.HStore(310): Store=7034d5b2c08dbe7b30da55189a3347ba/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:35,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,798 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,802 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:11:35,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:35,806 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7034d5b2c08dbe7b30da55189a3347ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62886934, jitterRate=-0.06291165947914124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:35,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7034d5b2c08dbe7b30da55189a3347ba: 2023-07-13 23:11:35,809 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba., pid=6, masterSystemTime=1689289895777 2023-07-13 23:11:35,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:11:35,814 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7034d5b2c08dbe7b30da55189a3347ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:35,815 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689289895814"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289895814"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289895814"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289895814"}]},"ts":"1689289895814"} 2023-07-13 23:11:35,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-13 23:11:35,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7034d5b2c08dbe7b30da55189a3347ba, server=jenkins-hbase4.apache.org,41069,1689289892207 in 195 msec 2023-07-13 23:11:35,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-13 23:11:35,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7034d5b2c08dbe7b30da55189a3347ba, ASSIGN in 362 msec 2023-07-13 23:11:35,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:35,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289895826"}]},"ts":"1689289895826"} 2023-07-13 23:11:35,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-13 23:11:35,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:35,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-13 23:11:35,833 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:35,833 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:35,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 618 msec 2023-07-13 23:11:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:35,857 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:35,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-13 23:11:35,886 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:35,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-13 23:11:35,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-13 23:11:35,913 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 23:11:35,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-07-13 23:11:35,931 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-13 23:11:35,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-13 23:11:35,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.488sec 2023-07-13 23:11:35,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-13 23:11:35,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-13 23:11:35,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-13 23:11:35,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39197,1689289890670-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-13 23:11:35,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39197,1689289890670-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-13 23:11:35,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:35,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-13 23:11:35,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:35,975 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:35,979 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:35,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-13 23:11:35,979 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a empty. 2023-07-13 23:11:35,982 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:35,982 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-13 23:11:35,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,004 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:36,006 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2fcaaf78226c27a5b54c3c7a865cd50a, NAME => 'hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:11:36,028 DEBUG [Listener at localhost/33781] zookeeper.ReadOnlyZKClient(139): Connect 0x3a17b1de to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:36,028 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:36,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2fcaaf78226c27a5b54c3c7a865cd50a, disabling compactions & flushes 2023-07-13 23:11:36,029 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. after waiting 0 ms 2023-07-13 23:11:36,029 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,030 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,030 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2fcaaf78226c27a5b54c3c7a865cd50a: 2023-07-13 23:11:36,033 DEBUG [Listener at localhost/33781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e1615e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:36,035 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:36,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289896036"}]},"ts":"1689289896036"} 2023-07-13 23:11:36,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 23:11:36,043 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:36,043 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289896043"}]},"ts":"1689289896043"} 2023-07-13 23:11:36,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-13 23:11:36,051 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:36,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:36,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:36,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:36,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:36,052 DEBUG [hconnection-0x20e21997-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:36,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2fcaaf78226c27a5b54c3c7a865cd50a, ASSIGN}] 2023-07-13 23:11:36,056 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2fcaaf78226c27a5b54c3c7a865cd50a, ASSIGN 2023-07-13 23:11:36,057 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2fcaaf78226c27a5b54c3c7a865cd50a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:11:36,068 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:36,071 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/test.cache.data in system properties and HBase conf 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop.log.dir in system properties and HBase conf 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 23:11:36,072 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:36,073 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 23:11:36,074 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/nfs.dump.dir in system properties and HBase conf 2023-07-13 23:11:36,074 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir in system properties and HBase conf 2023-07-13 23:11:36,074 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 23:11:36,074 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 23:11:36,074 INFO [Listener at localhost/33781] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-13 23:11:36,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,208 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:11:36,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2fcaaf78226c27a5b54c3c7a865cd50a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:36,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289896209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289896209"}]},"ts":"1689289896209"} 2023-07-13 23:11:36,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2fcaaf78226c27a5b54c3c7a865cd50a, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:11:36,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,369 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:36,369 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:11:36,371 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:11:36,381 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fcaaf78226c27a5b54c3c7a865cd50a, NAME => 'hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:11:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. service=AccessControlService 2023-07-13 23:11:36,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:36,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,386 INFO [StoreOpener-2fcaaf78226c27a5b54c3c7a865cd50a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,389 DEBUG [StoreOpener-2fcaaf78226c27a5b54c3c7a865cd50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/l 2023-07-13 23:11:36,389 DEBUG [StoreOpener-2fcaaf78226c27a5b54c3c7a865cd50a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/l 2023-07-13 23:11:36,389 INFO [StoreOpener-2fcaaf78226c27a5b54c3c7a865cd50a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fcaaf78226c27a5b54c3c7a865cd50a columnFamilyName l 2023-07-13 23:11:36,390 INFO [StoreOpener-2fcaaf78226c27a5b54c3c7a865cd50a-1] regionserver.HStore(310): Store=2fcaaf78226c27a5b54c3c7a865cd50a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:36,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,403 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:11:36,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:36,410 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fcaaf78226c27a5b54c3c7a865cd50a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68688960, jitterRate=0.023545265197753906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:36,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fcaaf78226c27a5b54c3c7a865cd50a: 2023-07-13 23:11:36,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a., pid=11, masterSystemTime=1689289896369 2023-07-13 23:11:36,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:11:36,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2fcaaf78226c27a5b54c3c7a865cd50a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:36,420 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689289896420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289896420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289896420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289896420"}]},"ts":"1689289896420"} 2023-07-13 23:11:36,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-13 23:11:36,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2fcaaf78226c27a5b54c3c7a865cd50a, server=jenkins-hbase4.apache.org,40551,1689289892359 in 211 msec 2023-07-13 23:11:36,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-13 23:11:36,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2fcaaf78226c27a5b54c3c7a865cd50a, ASSIGN in 383 msec 2023-07-13 23:11:36,453 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:36,454 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289896454"}]},"ts":"1689289896454"} 2023-07-13 23:11:36,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-13 23:11:36,462 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:36,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 493 msec 2023-07-13 23:11:36,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 23:11:36,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-13 23:11:36,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-13 23:11:37,726 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:38,119 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:38,129 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43295_jobhistory____qcco9k/webapp 2023-07-13 23:11:38,366 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-13 23:11:38,366 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:38,366 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:38,370 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:38,462 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:38,826 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:39,218 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-13 23:11:39,307 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43295 2023-07-13 23:11:40,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:11:40,727 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-13 23:11:40,730 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-13 23:11:40,731 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-13 23:11:40,776 WARN [Listener at jenkins-hbase4.apache.org/36061] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:40,854 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:40,855 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-13 23:11:40,855 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:40,855 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-13 23:11:40,856 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 23:11:40,856 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-13 23:11:40,856 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:11:40,856 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-13 23:11:40,856 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 23:11:40,856 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-13 23:11:40,875 WARN [Listener at jenkins-hbase4.apache.org/36061] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:40,876 INFO [Listener at jenkins-hbase4.apache.org/36061] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:40,883 INFO [Listener at jenkins-hbase4.apache.org/36061] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43341_cluster____.pu6fh/webapp 2023-07-13 23:11:40,979 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-13 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36061] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:40,993 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,222 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,339 INFO [Listener at jenkins-hbase4.apache.org/36061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:41,352 INFO [Listener at jenkins-hbase4.apache.org/36061] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43341 2023-07-13 23:11:41,983 WARN [Listener at jenkins-hbase4.apache.org/35247] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:42,009 WARN [Listener at jenkins-hbase4.apache.org/35247] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:42,010 INFO [Listener at jenkins-hbase4.apache.org/35247] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:42,019 INFO [Listener at jenkins-hbase4.apache.org/35247] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33463_node____.rvtm41/webapp 2023-07-13 23:11:42,087 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 23:11:42,087 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:42,087 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:42,087 INFO [Listener at jenkins-hbase4.apache.org/35247] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:42,095 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,119 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,222 INFO [Listener at jenkins-hbase4.apache.org/35247] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,247 INFO [Listener at jenkins-hbase4.apache.org/35247] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33463 2023-07-13 23:11:42,645 WARN [Listener at jenkins-hbase4.apache.org/41829] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 23:11:42,653 WARN [Listener at jenkins-hbase4.apache.org/41829] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 23:11:42,654 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 23:11:42,661 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42331_node____.6ne5nz/webapp 2023-07-13 23:11:42,717 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 23:11:42,717 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 23:11:42,718 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 23:11:42,718 INFO [Listener at jenkins-hbase4.apache.org/41829] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 23:11:42,727 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,747 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,839 INFO [Listener at jenkins-hbase4.apache.org/41829] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 23:11:42,855 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42331 2023-07-13 23:11:42,891 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-13 23:11:42,893 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:42,962 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=175, AvailableMemoryMB=5862 2023-07-13 23:11:42,962 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-13 23:11:42,975 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-13 23:11:42,982 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-13 23:11:42,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:11:42,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:11:42,996 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:11:42,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-13 23:11:42,999 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:11:43,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,004 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,004 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 empty. 2023-07-13 23:11:43,006 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 empty. 2023-07-13 23:11:43,006 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,007 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 23:11:43,047 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-13 23:11:43,048 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbffe76d8aecd7fc92aa0d68893867d5, NAME => 'testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:11:43,049 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b0d15235cf1a581413c069b81fc56e24, NAME => 'testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:11:43,097 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,097 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b0d15235cf1a581413c069b81fc56e24, disabling compactions & flushes 2023-07-13 23:11:43,097 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,097 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,097 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. after waiting 0 ms 2023-07-13 23:11:43,097 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,098 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,098 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b0d15235cf1a581413c069b81fc56e24: 2023-07-13 23:11:43,099 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,101 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing dbffe76d8aecd7fc92aa0d68893867d5, disabling compactions & flushes 2023-07-13 23:11:43,101 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,101 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,101 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. after waiting 0 ms 2023-07-13 23:11:43,101 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,101 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,101 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for dbffe76d8aecd7fc92aa0d68893867d5: 2023-07-13 23:11:43,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,109 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:11:43,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289903110"}]},"ts":"1689289903110"} 2023-07-13 23:11:43,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289903110"}]},"ts":"1689289903110"} 2023-07-13 23:11:43,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:11:43,164 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:11:43,164 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289903164"}]},"ts":"1689289903164"} 2023-07-13 23:11:43,167 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-13 23:11:43,172 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:11:43,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:11:43,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:11:43,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:11:43,174 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:11:43,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, ASSIGN}] 2023-07-13 23:11:43,177 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, ASSIGN 2023-07-13 23:11:43,177 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, ASSIGN 2023-07-13 23:11:43,179 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:11:43,179 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:11:43,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,329 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:11:43,332 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dbffe76d8aecd7fc92aa0d68893867d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:43,332 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b0d15235cf1a581413c069b81fc56e24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:43,332 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289903332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289903332"}]},"ts":"1689289903332"} 2023-07-13 23:11:43,332 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289903332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289903332"}]},"ts":"1689289903332"} 2023-07-13 23:11:43,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure b0d15235cf1a581413c069b81fc56e24, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:11:43,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure dbffe76d8aecd7fc92aa0d68893867d5, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:11:43,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0d15235cf1a581413c069b81fc56e24, NAME => 'testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:11:43,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbffe76d8aecd7fc92aa0d68893867d5, NAME => 'testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:11:43,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. service=AccessControlService 2023-07-13 23:11:43,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. service=AccessControlService 2023-07-13 23:11:43,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:43,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:11:43,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,497 INFO [StoreOpener-dbffe76d8aecd7fc92aa0d68893867d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,497 INFO [StoreOpener-b0d15235cf1a581413c069b81fc56e24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,499 DEBUG [StoreOpener-dbffe76d8aecd7fc92aa0d68893867d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf 2023-07-13 23:11:43,499 DEBUG [StoreOpener-dbffe76d8aecd7fc92aa0d68893867d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf 2023-07-13 23:11:43,499 DEBUG [StoreOpener-b0d15235cf1a581413c069b81fc56e24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf 2023-07-13 23:11:43,500 DEBUG [StoreOpener-b0d15235cf1a581413c069b81fc56e24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf 2023-07-13 23:11:43,500 INFO [StoreOpener-dbffe76d8aecd7fc92aa0d68893867d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbffe76d8aecd7fc92aa0d68893867d5 columnFamilyName cf 2023-07-13 23:11:43,500 INFO [StoreOpener-b0d15235cf1a581413c069b81fc56e24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0d15235cf1a581413c069b81fc56e24 columnFamilyName cf 2023-07-13 23:11:43,500 INFO [StoreOpener-dbffe76d8aecd7fc92aa0d68893867d5-1] regionserver.HStore(310): Store=dbffe76d8aecd7fc92aa0d68893867d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:43,502 INFO [StoreOpener-b0d15235cf1a581413c069b81fc56e24-1] regionserver.HStore(310): Store=b0d15235cf1a581413c069b81fc56e24/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:11:43,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:11:43,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:11:43,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:43,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b0d15235cf1a581413c069b81fc56e24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65431263, jitterRate=-0.024998202919960022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:43,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b0d15235cf1a581413c069b81fc56e24: 2023-07-13 23:11:43,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24., pid=15, masterSystemTime=1689289903488 2023-07-13 23:11:43,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:11:43,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbffe76d8aecd7fc92aa0d68893867d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59037614, jitterRate=-0.1202709972858429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:11:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbffe76d8aecd7fc92aa0d68893867d5: 2023-07-13 23:11:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:43,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5., pid=16, masterSystemTime=1689289903489 2023-07-13 23:11:43,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b0d15235cf1a581413c069b81fc56e24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:43,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903526"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289903526"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289903526"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289903526"}]},"ts":"1689289903526"} 2023-07-13 23:11:43,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:43,530 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dbffe76d8aecd7fc92aa0d68893867d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:43,532 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289903530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289903530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289903530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289903530"}]},"ts":"1689289903530"} 2023-07-13 23:11:43,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-13 23:11:43,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure b0d15235cf1a581413c069b81fc56e24, server=jenkins-hbase4.apache.org,45125,1689289892301 in 198 msec 2023-07-13 23:11:43,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-13 23:11:43,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure dbffe76d8aecd7fc92aa0d68893867d5, server=jenkins-hbase4.apache.org,40551,1689289892359 in 199 msec 2023-07-13 23:11:43,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, ASSIGN in 363 msec 2023-07-13 23:11:43,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-13 23:11:43,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, ASSIGN in 373 msec 2023-07-13 23:11:43,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:11:43,553 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289903553"}]},"ts":"1689289903553"} 2023-07-13 23:11:43,556 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-13 23:11:43,559 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:11:43,564 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-13 23:11:43,570 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:43,573 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:43,577 DEBUG [hconnection-0x615ac902-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:43,579 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-13 23:11:43,588 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:43,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:43,630 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,630 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,630 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,630 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 23:11:43,630 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:11:43,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 23:11:43,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 648 msec 2023-07-13 23:11:44,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 23:11:44,112 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-13 23:11:44,112 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-13 23:11:44,113 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:44,118 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-13 23:11:44,119 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:44,119 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-13 23:11:44,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289904137 (current time:1689289904137). 2023-07-13 23:11:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:11:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x70483c71 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7abf7851, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,149 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70483c71 to 127.0.0.1:63267 2023-07-13 23:11:44,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x61bbf43c to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25227be8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,173 DEBUG [hconnection-0x1fc6899f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,174 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,182 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61bbf43c to 127.0.0.1:63267 2023-07-13 23:11:44,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:44,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:11:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,245 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,246 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689290504246 2023-07-13 23:11:44,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 23:11:44,250 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-13 23:11:44,254 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,255 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689290504255 2023-07-13 23:11:44,256 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:11:44,256 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:11:44,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,287 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-13 23:11:44,287 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,288 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 23:11:44,288 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 23:11:44,288 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,288 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,294 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,294 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,294 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,295 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,295 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:11:44,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 23:11:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,300 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,300 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,300 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,300 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:44,303 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,302 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,304 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,307 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,307 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:44,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d1acf2[Count = 1] remaining members to acquire global barrier 2023-07-13 23:11:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d1acf2[Count = 0] remaining members to acquire global barrier 2023-07-13 23:11:44,316 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 23:11:44,316 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,318 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,318 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,318 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:11:44,320 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,320 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:11:44,320 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:44,320 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:44,320 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:44,321 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. started... 2023-07-13 23:11:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:44,327 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:44,327 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. started... 2023-07-13 23:11:44,328 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,328 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,328 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,335 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b0d15235cf1a581413c069b81fc56e24: 2023-07-13 23:11:44,332 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbffe76d8aecd7fc92aa0d68893867d5: 2023-07-13 23:11:44,340 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,340 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,348 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:44,348 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:44,352 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:11:44,352 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:11:44,358 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:44,367 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:11:44,391 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. completed. 2023-07-13 23:11:44,391 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:44,394 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:44,395 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:44,395 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,395 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,395 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:11:44,400 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,405 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. completed. 2023-07-13 23:11:44,405 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:44,405 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:44,405 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:44,405 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,405 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:44,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,405 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:11:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,409 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:11:44,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 23:11:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:11:44,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 23:11:44,417 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-13 23:11:44,418 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:11:44,418 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:11:44,418 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,418 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,421 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,422 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,423 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,425 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,428 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:44,428 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,428 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,444 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,444 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:44,444 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,445 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,444 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,443 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:44,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:44,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:44,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:44,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,567 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:44,571 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:11:44,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 23:11:44,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 23:11:44,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689289904247Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689289904444 (+197 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689289904446 (+2 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689289904462 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689289904483 (+21 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689289904576 (+93 ms) 2023-07-13 23:11:44,579 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 330 msec 2023-07-13 23:11:44,871 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:11:44,895 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,901 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45125] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:11:44,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:11:44,907 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 23:11:44,908 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:44,910 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:11:44,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289904949 (current time:1689289904949). 2023-07-13 23:11:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:11:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x3713853b to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39af4133, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,965 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3713853b to 127.0.0.1:63267 2023-07-13 23:11:44,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x4a6e0956 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:11:44,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61ff677d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:11:44,975 DEBUG [hconnection-0x221a04a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,977 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:11:44,982 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:11:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a6e0956 to 127.0.0.1:63267 2023-07-13 23:11:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:11:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 23:11:44,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:11:44,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,990 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,991 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689290504991 2023-07-13 23:11:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 23:11:44,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 23:11:44,995 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 23:11:44,995 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:11:44,995 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:11:44,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:44,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-13 23:11:44,999 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:45,000 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689290505000 2023-07-13 23:11:45,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-13 23:11:45,057 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-13 23:11:45,057 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,058 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 23:11:45,058 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 23:11:45,059 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,059 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,062 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,062 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,062 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,062 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,065 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 23:11:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:11:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,069 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 23:11:45,069 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 23:11:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 23:11:45,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:11:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7828672f[Count = 1] remaining members to acquire global barrier 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 23:11:45,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7828672f[Count = 0] remaining members to acquire global barrier 2023-07-13 23:11:45,081 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 23:11:45,081 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,086 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,087 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,087 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,087 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,087 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 23:11:45,087 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:11:45,088 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,088 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:11:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:45,091 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:45,092 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. started... 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:11:45,093 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b0d15235cf1a581413c069b81fc56e24 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-13 23:11:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. started... 2023-07-13 23:11:45,093 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dbffe76d8aecd7fc92aa0d68893867d5 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-13 23:11:45,095 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:45,097 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:11:45,203 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/.tmp/cf/9ec46ea85ac64b6f97a6312bd0fcec54 2023-07-13 23:11:45,207 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/.tmp/cf/2039ffb3a7644fd4a1509da5db1a957f 2023-07-13 23:11:45,257 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/.tmp/cf/9ec46ea85ac64b6f97a6312bd0fcec54 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54 2023-07-13 23:11:45,257 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/.tmp/cf/2039ffb3a7644fd4a1509da5db1a957f as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f 2023-07-13 23:11:45,269 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f, entries=49, sequenceid=6, filesize=8.1 K 2023-07-13 23:11:45,270 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54, entries=1, sequenceid=6, filesize=4.9 K 2023-07-13 23:11:45,275 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for dbffe76d8aecd7fc92aa0d68893867d5 in 182ms, sequenceid=6, compaction requested=false 2023-07-13 23:11:45,275 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for b0d15235cf1a581413c069b81fc56e24 in 182ms, sequenceid=6, compaction requested=false 2023-07-13 23:11:45,275 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 23:11:45,275 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 23:11:45,277 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b0d15235cf1a581413c069b81fc56e24: 2023-07-13 23:11:45,277 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbffe76d8aecd7fc92aa0d68893867d5: 2023-07-13 23:11:45,278 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,278 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,278 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:45,278 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:11:45,279 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f] hfiles 2023-07-13 23:11:45,279 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54] hfiles 2023-07-13 23:11:45,279 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,279 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54 for snapshot=snaptb0-testExportWithTargetName 2023-07-13 23:11:45,298 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:11:45,300 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:11:45,322 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. completed. 2023-07-13 23:11:45,322 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:11:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:11:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,329 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,329 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. completed. 2023-07-13 23:11:45,329 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:11:45,329 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:11:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:11:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 23:11:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:11:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,333 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 23:11:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,334 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 23:11:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:11:45,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 23:11:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:11:45,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 23:11:45,348 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-13 23:11:45,348 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:11:45,348 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:11:45,348 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-13 23:11:45,348 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:11:45,350 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,350 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,350 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,350 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:11:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:11:45,350 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,352 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:11:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,352 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,355 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:11:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:11:45,358 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 23:11:45,358 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,359 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-13 23:11:45,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:11:45,379 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:11:45,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,378 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:11:45,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:11:45,379 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:11:45,379 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:11:45,380 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,380 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:11:45,380 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:11:45,380 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,380 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:11:45,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:11:45,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 23:11:45,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,485 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 23:11:45,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689289904992Consolidate snapshot: snaptb0-testExportWithTargetName at 1689289905378 (+386 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689289905379 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689289905392 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689289905412 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689289905484 (+72 ms) 2023-07-13 23:11:45,486 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 23:11:45,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 494 msec 2023-07-13 23:11:45,600 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:11:45,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 23:11:45,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:11:45,604 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604 2023-07-13 23:11:45,604 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44557, tgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604, rawTgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:45,642 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:11:45,642 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1680521805_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 23:11:45,642 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-13 23:11:45,666 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 23:11:45,795 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:45,796 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:45,796 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:45,797 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,784 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-1162806431823027755.jar 2023-07-13 23:11:46,785 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,785 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,862 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-9177531426828340128.jar 2023-07-13 23:11:46,863 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,864 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,864 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,865 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,865 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,865 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:11:46,866 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:11:46,867 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:11:46,867 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:11:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:11:46,869 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:11:46,870 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:11:46,870 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:11:46,870 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:11:46,871 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:11:46,872 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:11:46,875 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:46,876 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:46,877 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:46,878 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:46,878 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:11:46,879 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:46,879 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:11:47,935 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:11:47,941 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-13 23:11:47,951 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 23:11:48,569 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:11:48,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:11:49,013 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:11:49,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0001_000001 (auth:SIMPLE) 2023-07-13 23:11:54,548 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0001_000001 (auth:SIMPLE) 2023-07-13 23:11:56,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0001_000001 (auth:SIMPLE) 2023-07-13 23:11:59,752 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0001_000001 (auth:SIMPLE) 2023-07-13 23:12:00,964 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:00,966 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:00,974 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-13 23:12:00,974 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:00,975 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:00,975 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 23:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-13 23:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-13 23:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/testExportWithTargetName 2023-07-13 23:12:00,977 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-13 23:12:00,977 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289905604/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-13 23:12:00,986 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-13 23:12:00,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-13 23:12:00,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289921003"}]},"ts":"1689289921003"} 2023-07-13 23:12:01,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:01,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-13 23:12:01,007 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-13 23:12:01,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, UNASSIGN}] 2023-07-13 23:12:01,011 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, UNASSIGN 2023-07-13 23:12:01,011 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, UNASSIGN 2023-07-13 23:12:01,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=dbffe76d8aecd7fc92aa0d68893867d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:01,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b0d15235cf1a581413c069b81fc56e24, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:01,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289921012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289921012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289921012"}]},"ts":"1689289921012"} 2023-07-13 23:12:01,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289921012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289921012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289921012"}]},"ts":"1689289921012"} 2023-07-13 23:12:01,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure dbffe76d8aecd7fc92aa0d68893867d5, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:01,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b0d15235cf1a581413c069b81fc56e24, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:01,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:01,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:12:01,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b0d15235cf1a581413c069b81fc56e24, disabling compactions & flushes 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbffe76d8aecd7fc92aa0d68893867d5, disabling compactions & flushes 2023-07-13 23:12:01,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:12:01,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. after waiting 0 ms 2023-07-13 23:12:01,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:12:01,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. after waiting 0 ms 2023-07-13 23:12:01,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:12:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:01,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:01,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:01,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5. 2023-07-13 23:12:01,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24. 2023-07-13 23:12:01,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbffe76d8aecd7fc92aa0d68893867d5: 2023-07-13 23:12:01,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b0d15235cf1a581413c069b81fc56e24: 2023-07-13 23:12:01,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:12:01,199 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b0d15235cf1a581413c069b81fc56e24, regionState=CLOSED 2023-07-13 23:12:01,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289921199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289921199"}]},"ts":"1689289921199"} 2023-07-13 23:12:01,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:12:01,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=dbffe76d8aecd7fc92aa0d68893867d5, regionState=CLOSED 2023-07-13 23:12:01,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689289921201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289921201"}]},"ts":"1689289921201"} 2023-07-13 23:12:01,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-13 23:12:01,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b0d15235cf1a581413c069b81fc56e24, server=jenkins-hbase4.apache.org,45125,1689289892301 in 187 msec 2023-07-13 23:12:01,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-13 23:12:01,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure dbffe76d8aecd7fc92aa0d68893867d5, server=jenkins-hbase4.apache.org,40551,1689289892359 in 189 msec 2023-07-13 23:12:01,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b0d15235cf1a581413c069b81fc56e24, UNASSIGN in 196 msec 2023-07-13 23:12:01,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-13 23:12:01,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dbffe76d8aecd7fc92aa0d68893867d5, UNASSIGN in 197 msec 2023-07-13 23:12:01,210 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289921209"}]},"ts":"1689289921209"} 2023-07-13 23:12:01,211 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-13 23:12:01,213 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-13 23:12:01,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 220 msec 2023-07-13 23:12:01,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 23:12:01,307 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-13 23:12:01,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-13 23:12:01,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,322 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-13 23:12:01,324 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,327 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-13 23:12:01,330 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:12:01,330 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:12:01,331 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:01,331 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:01,331 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:01,331 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 23:12:01,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:01,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:01,333 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:01,333 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:01,333 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:01,333 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:01,333 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 23:12:01,333 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:01,335 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/recovered.edits] 2023-07-13 23:12:01,335 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/recovered.edits] 2023-07-13 23:12:01,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 23:12:01,343 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/cf/9ec46ea85ac64b6f97a6312bd0fcec54 2023-07-13 23:12:01,343 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/cf/2039ffb3a7644fd4a1509da5db1a957f 2023-07-13 23:12:01,347 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5/recovered.edits/9.seqid 2023-07-13 23:12:01,347 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24/recovered.edits/9.seqid 2023-07-13 23:12:01,348 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/dbffe76d8aecd7fc92aa0d68893867d5 2023-07-13 23:12:01,348 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportWithTargetName/b0d15235cf1a581413c069b81fc56e24 2023-07-13 23:12:01,348 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 23:12:01,351 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,372 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-13 23:12:01,374 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-13 23:12:01,376 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,376 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-13 23:12:01,376 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289921376"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:01,376 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289921376"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:01,378 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:01,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dbffe76d8aecd7fc92aa0d68893867d5, NAME => 'testtb-testExportWithTargetName,,1689289902990.dbffe76d8aecd7fc92aa0d68893867d5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b0d15235cf1a581413c069b81fc56e24, NAME => 'testtb-testExportWithTargetName,1,1689289902990.b0d15235cf1a581413c069b81fc56e24.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:01,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-13 23:12:01,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289921378"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:01,380 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-13 23:12:01,383 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 23:12:01,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 70 msec 2023-07-13 23:12:01,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 23:12:01,438 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-13 23:12:01,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-13 23:12:01,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-13 23:12:01,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-13 23:12:01,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-13 23:12:01,493 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=754 (was 709) Potentially hanging thread: (jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:33329 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1517431080_1 at /127.0.0.1:59878 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:57020 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:39020 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1517431080_1 at /127.0.0.1:59336 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:37966 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:37301 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=362 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=4030 (was 5862) 2023-07-13 23:12:01,494 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-13 23:12:01,515 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=362, ProcessCount=181, AvailableMemoryMB=4029 2023-07-13 23:12:01,515 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-13 23:12:01,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:12:01,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:01,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:01,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-13 23:12:01,523 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:01,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:01,526 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,526 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 empty. 2023-07-13 23:12:01,527 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 empty. 2023-07-13 23:12:01,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,527 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,527 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 23:12:01,545 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:01,547 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 882512a97d0e999eb13aa6a333842606, NAME => 'testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:01,547 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1c5918cca1331aad679a2cf6deb7bcd2, NAME => 'testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:01,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:01,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 882512a97d0e999eb13aa6a333842606, disabling compactions & flushes 2023-07-13 23:12:01,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. after waiting 0 ms 2023-07-13 23:12:01,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 882512a97d0e999eb13aa6a333842606: 2023-07-13 23:12:01,569 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:01,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1c5918cca1331aad679a2cf6deb7bcd2, disabling compactions & flushes 2023-07-13 23:12:01,570 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. after waiting 0 ms 2023-07-13 23:12:01,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1c5918cca1331aad679a2cf6deb7bcd2: 2023-07-13 23:12:01,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:01,575 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289921575"}]},"ts":"1689289921575"} 2023-07-13 23:12:01,575 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289921575"}]},"ts":"1689289921575"} 2023-07-13 23:12:01,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:01,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:01,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289921579"}]},"ts":"1689289921579"} 2023-07-13 23:12:01,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 23:12:01,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:01,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:01,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:01,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:01,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:01,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, ASSIGN}] 2023-07-13 23:12:01,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, ASSIGN 2023-07-13 23:12:01,589 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, ASSIGN 2023-07-13 23:12:01,590 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:12:01,590 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:12:01,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:01,740 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:01,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1c5918cca1331aad679a2cf6deb7bcd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:01,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=882512a97d0e999eb13aa6a333842606, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:01,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289921742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289921742"}]},"ts":"1689289921742"} 2023-07-13 23:12:01,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289921742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289921742"}]},"ts":"1689289921742"} 2023-07-13 23:12:01,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 1c5918cca1331aad679a2cf6deb7bcd2, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:01,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 882512a97d0e999eb13aa6a333842606, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:01,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:01,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c5918cca1331aad679a2cf6deb7bcd2, NAME => 'testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:01,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 882512a97d0e999eb13aa6a333842606, NAME => 'testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:01,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. service=AccessControlService 2023-07-13 23:12:01,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. service=AccessControlService 2023-07-13 23:12:01,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,903 INFO [StoreOpener-1c5918cca1331aad679a2cf6deb7bcd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,904 INFO [StoreOpener-882512a97d0e999eb13aa6a333842606-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,905 DEBUG [StoreOpener-1c5918cca1331aad679a2cf6deb7bcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf 2023-07-13 23:12:01,905 DEBUG [StoreOpener-1c5918cca1331aad679a2cf6deb7bcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf 2023-07-13 23:12:01,905 DEBUG [StoreOpener-882512a97d0e999eb13aa6a333842606-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf 2023-07-13 23:12:01,905 DEBUG [StoreOpener-882512a97d0e999eb13aa6a333842606-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf 2023-07-13 23:12:01,905 INFO [StoreOpener-1c5918cca1331aad679a2cf6deb7bcd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c5918cca1331aad679a2cf6deb7bcd2 columnFamilyName cf 2023-07-13 23:12:01,905 INFO [StoreOpener-882512a97d0e999eb13aa6a333842606-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 882512a97d0e999eb13aa6a333842606 columnFamilyName cf 2023-07-13 23:12:01,906 INFO [StoreOpener-1c5918cca1331aad679a2cf6deb7bcd2-1] regionserver.HStore(310): Store=1c5918cca1331aad679a2cf6deb7bcd2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:01,907 INFO [StoreOpener-882512a97d0e999eb13aa6a333842606-1] regionserver.HStore(310): Store=882512a97d0e999eb13aa6a333842606/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:01,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:01,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:01,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c5918cca1331aad679a2cf6deb7bcd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71766722, jitterRate=0.06940749287605286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:01,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c5918cca1331aad679a2cf6deb7bcd2: 2023-07-13 23:12:01,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 882512a97d0e999eb13aa6a333842606; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67465852, jitterRate=0.005319535732269287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:01,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 882512a97d0e999eb13aa6a333842606: 2023-07-13 23:12:01,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2., pid=30, masterSystemTime=1689289921896 2023-07-13 23:12:01,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606., pid=31, masterSystemTime=1689289921897 2023-07-13 23:12:01,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:01,918 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=882512a97d0e999eb13aa6a333842606, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:01,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,919 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921918"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289921918"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289921918"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289921918"}]},"ts":"1689289921918"} 2023-07-13 23:12:01,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:01,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1c5918cca1331aad679a2cf6deb7bcd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:01,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289921920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289921920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289921920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289921920"}]},"ts":"1689289921920"} 2023-07-13 23:12:01,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-13 23:12:01,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 882512a97d0e999eb13aa6a333842606, server=jenkins-hbase4.apache.org,45125,1689289892301 in 178 msec 2023-07-13 23:12:01,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-13 23:12:01,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, ASSIGN in 340 msec 2023-07-13 23:12:01,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 1c5918cca1331aad679a2cf6deb7bcd2, server=jenkins-hbase4.apache.org,40551,1689289892359 in 180 msec 2023-07-13 23:12:01,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-13 23:12:01,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, ASSIGN in 343 msec 2023-07-13 23:12:01,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:01,934 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289921934"}]},"ts":"1689289921934"} 2023-07-13 23:12:01,936 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 23:12:01,938 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:01,939 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-13 23:12:01,941 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:01,942 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,942 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,942 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,942 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:01,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:01,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:01,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:01,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:01,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 426 msec 2023-07-13 23:12:02,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 23:12:02,127 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-13 23:12:02,127 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-13 23:12:02,128 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:02,132 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-13 23:12:02,132 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:02,132 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-13 23:12:02,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289922135 (current time:1689289922135). 2023-07-13 23:12:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:02,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x4f198f3e to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:02,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@210ce83c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:02,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,146 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f198f3e to 127.0.0.1:63267 2023-07-13 23:12:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:02,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x4ede0c83 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:02,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dbd0a19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:02,155 DEBUG [hconnection-0xbb6569a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,157 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,164 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ede0c83 to 127.0.0.1:63267 2023-07-13 23:12:02,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:02,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:02,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:02,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,170 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,172 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290522172 2023-07-13 23:12:02,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 23:12:02,174 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:02,174 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:02,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:02,178 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-13 23:12:02,181 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:02,182 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290522182 2023-07-13 23:12:02,274 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:02,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:02,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:02,276 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:02,476 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:02,477 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:02,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,600 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-13 23:12:02,600 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,601 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 23:12:02,601 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:12:02,601 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,601 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,602 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,602 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,602 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,602 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,603 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,603 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,604 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,604 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,604 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,607 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,606 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,607 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,607 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,610 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,610 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,622 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,622 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68242958[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:02,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68242958[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:02,629 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:12:02,629 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:02,632 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,633 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,633 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:02,633 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:02,633 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. started... 2023-07-13 23:12:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:02,633 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:02,633 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. started... 2023-07-13 23:12:02,635 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5918cca1331aad679a2cf6deb7bcd2: 2023-07-13 23:12:02,636 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 882512a97d0e999eb13aa6a333842606: 2023-07-13 23:12:02,636 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,636 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,636 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,637 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,638 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:02,638 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:02,638 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,638 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:02,638 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:02,659 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. completed. 2023-07-13 23:12:02,659 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:02,659 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:02,659 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:02,660 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,660 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,660 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:02,661 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. completed. 2023-07-13 23:12:02,662 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:02,662 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:02,662 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:02,662 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,662 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,662 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:02,663 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,663 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,663 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,663 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,665 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,665 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,665 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:12:02,674 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-13 23:12:02,674 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:02,674 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:02,674 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,674 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,677 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,677 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,678 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,680 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,680 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,680 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,683 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,685 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,685 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,683 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,685 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,685 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:02,686 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,686 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,686 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:02,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 23:12:02,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,728 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:02,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689289922173Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689289922685 (+512 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689289922686 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689289922690 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689289922699 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689289922728 (+29 ms) 2023-07-13 23:12:02,731 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:02,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 557 msec 2023-07-13 23:12:02,778 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:02,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:02,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:02,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45125] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:02,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:02,793 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 23:12:02,794 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:02,795 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:02,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289922807 (current time:1689289922807). 2023-07-13 23:12:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x19834620 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:02,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ebcc4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:02,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,817 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19834620 to 127.0.0.1:63267 2023-07-13 23:12:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x64bc68ea to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:02,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39dab111, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:02,827 DEBUG [hconnection-0x24ecda68-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,828 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:02,834 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:02,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64bc68ea to 127.0.0.1:63267 2023-07-13 23:12:02,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:02,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:12:02,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:02,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,840 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,841 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290522841 2023-07-13 23:12:02,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:12:02,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 23:12:02,842 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:02,842 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:02,844 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:12:02,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:02,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-13 23:12:02,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:02,847 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290522847 2023-07-13 23:12:02,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-13 23:12:02,859 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-13 23:12:02,859 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,860 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 23:12:02,860 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:12:02,860 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,860 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,862 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:02,862 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,862 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,863 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:02,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 23:12:02,864 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,864 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:02,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 23:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 23:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:02,869 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 23:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 23:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,870 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 23:12:02,871 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,872 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,872 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,872 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,872 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,875 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ad72b84[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 23:12:02,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ad72b84[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:02,879 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:12:02,879 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,880 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:02,881 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:02,881 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:02,881 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:02,882 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. started... 2023-07-13 23:12:02,882 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 882512a97d0e999eb13aa6a333842606 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-13 23:12:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:02,883 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:02,883 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. started... 2023-07-13 23:12:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,884 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c5918cca1331aad679a2cf6deb7bcd2 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-13 23:12:02,909 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/.tmp/cf/09811393434e456893272a2bbe49bafd 2023-07-13 23:12:02,910 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/.tmp/cf/4b8eeffc869144ebbd0fca1592385661 2023-07-13 23:12:02,922 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/.tmp/cf/4b8eeffc869144ebbd0fca1592385661 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661 2023-07-13 23:12:02,924 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/.tmp/cf/09811393434e456893272a2bbe49bafd as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd 2023-07-13 23:12:02,931 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661, entries=49, sequenceid=6, filesize=8.1 K 2023-07-13 23:12:02,933 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd, entries=1, sequenceid=6, filesize=4.9 K 2023-07-13 23:12:02,938 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 882512a97d0e999eb13aa6a333842606 in 56ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:02,938 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 1c5918cca1331aad679a2cf6deb7bcd2 in 55ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:02,939 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 23:12:02,939 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 23:12:02,941 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 882512a97d0e999eb13aa6a333842606: 2023-07-13 23:12:02,941 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c5918cca1331aad679a2cf6deb7bcd2: 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd] hfiles 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:02,942 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:02,942 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:02,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:02,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:02,944 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661] hfiles 2023-07-13 23:12:02,944 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661 for snapshot=snaptb0-testExportFileSystemState 2023-07-13 23:12:02,944 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:02,967 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. completed. 2023-07-13 23:12:02,967 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,972 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:12:02,989 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. completed. 2023-07-13 23:12:02,990 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 23:12:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:02,993 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 23:12:02,993 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:02,993 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,993 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 23:12:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:03,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:12:03,001 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-13 23:12:03,001 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:03,001 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:03,002 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-13 23:12:03,002 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,006 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:03,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,007 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:03,008 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:03,009 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:03,015 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 23:12:03,016 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,016 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,025 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,025 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:03,025 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:03,026 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:03,025 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-13 23:12:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:03,025 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-13 23:12:03,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:03,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:03,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:03,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:03,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:03,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 23:12:03,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689289922841Consolidate snapshot: snaptb0-testExportFileSystemState at 1689289923030 (+189 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689289923030Writing data manifest for snaptb0-testExportFileSystemState at 1689289923041 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689289923067 (+26 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689289923109 (+42 ms) 2023-07-13 23:12:03,112 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 23:12:03,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 270 msec 2023-07-13 23:12:03,144 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:03,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:12:03,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:03,147 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147 2023-07-13 23:12:03,147 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44557, tgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147, rawTgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:03,174 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:03,174 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_666035179_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,175 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-13 23:12:03,187 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 23:12:03,623 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:03,624 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:03,624 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:03,624 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,633 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-2472557834831957860.jar 2023-07-13 23:12:04,634 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,635 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,712 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-3778206781417506701.jar 2023-07-13 23:12:04,717 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,718 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,718 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,718 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,719 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,719 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:04,720 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:04,720 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:04,721 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:04,721 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:04,722 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:04,726 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:04,727 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:04,727 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:04,727 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:04,728 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:04,728 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:04,729 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:04,730 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:04,730 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:04,730 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:04,731 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:04,732 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:05,718 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:05,735 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-13 23:12:05,738 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 23:12:05,991 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:05,991 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:05,997 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0001_000001 (auth:SIMPLE) 2023-07-13 23:12:06,507 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:06,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:12:11,367 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:13,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:16,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:17,991 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:17,994 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:18,003 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-13 23:12:18,003 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:18,004 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:18,004 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:18,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 23:12:18,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 23:12:18,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 23:12:18,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 23:12:18,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289923147/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 23:12:18,012 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-13 23:12:18,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-13 23:12:18,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:18,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289938017"}]},"ts":"1689289938017"} 2023-07-13 23:12:18,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 23:12:18,021 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-13 23:12:18,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, UNASSIGN}] 2023-07-13 23:12:18,024 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, UNASSIGN 2023-07-13 23:12:18,024 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, UNASSIGN 2023-07-13 23:12:18,025 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1c5918cca1331aad679a2cf6deb7bcd2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:18,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=882512a97d0e999eb13aa6a333842606, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:18,025 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938025"}]},"ts":"1689289938025"} 2023-07-13 23:12:18,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938025"}]},"ts":"1689289938025"} 2023-07-13 23:12:18,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 1c5918cca1331aad679a2cf6deb7bcd2, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:18,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 882512a97d0e999eb13aa6a333842606, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:18,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:18,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:18,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c5918cca1331aad679a2cf6deb7bcd2, disabling compactions & flushes 2023-07-13 23:12:18,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:18,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:18,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. after waiting 0 ms 2023-07-13 23:12:18,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:18,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:18,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 882512a97d0e999eb13aa6a333842606, disabling compactions & flushes 2023-07-13 23:12:18,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:18,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:18,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. after waiting 0 ms 2023-07-13 23:12:18,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:18,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:18,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:18,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:18,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:18,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2. 2023-07-13 23:12:18,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606. 2023-07-13 23:12:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c5918cca1331aad679a2cf6deb7bcd2: 2023-07-13 23:12:18,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 882512a97d0e999eb13aa6a333842606: 2023-07-13 23:12:18,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:18,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1c5918cca1331aad679a2cf6deb7bcd2, regionState=CLOSED 2023-07-13 23:12:18,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:18,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289938201"}]},"ts":"1689289938201"} 2023-07-13 23:12:18,202 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=882512a97d0e999eb13aa6a333842606, regionState=CLOSED 2023-07-13 23:12:18,202 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689289938202"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289938202"}]},"ts":"1689289938202"} 2023-07-13 23:12:18,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-13 23:12:18,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-13 23:12:18,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 882512a97d0e999eb13aa6a333842606, server=jenkins-hbase4.apache.org,45125,1689289892301 in 173 msec 2023-07-13 23:12:18,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 1c5918cca1331aad679a2cf6deb7bcd2, server=jenkins-hbase4.apache.org,40551,1689289892359 in 173 msec 2023-07-13 23:12:18,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=882512a97d0e999eb13aa6a333842606, UNASSIGN in 184 msec 2023-07-13 23:12:18,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-13 23:12:18,209 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1c5918cca1331aad679a2cf6deb7bcd2, UNASSIGN in 184 msec 2023-07-13 23:12:18,209 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289938209"}]},"ts":"1689289938209"} 2023-07-13 23:12:18,210 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 23:12:18,212 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-13 23:12:18,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-13 23:12:18,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 23:12:18,320 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-13 23:12:18,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-13 23:12:18,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,324 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-13 23:12:18,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,327 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-13 23:12:18,330 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:18,330 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:18,330 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,330 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,330 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,330 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:18,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 23:12:18,332 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,333 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-13 23:12:18,333 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:18,333 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/recovered.edits] 2023-07-13 23:12:18,333 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/recovered.edits] 2023-07-13 23:12:18,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 23:12:18,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 23:12:18,338 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/cf/4b8eeffc869144ebbd0fca1592385661 2023-07-13 23:12:18,338 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/cf/09811393434e456893272a2bbe49bafd 2023-07-13 23:12:18,342 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2/recovered.edits/9.seqid 2023-07-13 23:12:18,342 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606/recovered.edits/9.seqid 2023-07-13 23:12:18,343 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/1c5918cca1331aad679a2cf6deb7bcd2 2023-07-13 23:12:18,343 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemState/882512a97d0e999eb13aa6a333842606 2023-07-13 23:12:18,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 23:12:18,345 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,347 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-13 23:12:18,349 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-13 23:12:18,350 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-13 23:12:18,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289938351"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:18,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289938351"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:18,353 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:18,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 882512a97d0e999eb13aa6a333842606, NAME => 'testtb-testExportFileSystemState,,1689289921516.882512a97d0e999eb13aa6a333842606.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1c5918cca1331aad679a2cf6deb7bcd2, NAME => 'testtb-testExportFileSystemState,1,1689289921516.1c5918cca1331aad679a2cf6deb7bcd2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:18,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-13 23:12:18,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289938353"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:18,354 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-13 23:12:18,356 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 23:12:18,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 35 msec 2023-07-13 23:12:18,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 23:12:18,436 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-13 23:12:18,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-13 23:12:18,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-13 23:12:18,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-13 23:12:18,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-13 23:12:18,474 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=764 (was 754) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:47972 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1239743791_1 at /127.0.0.1:57660 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:44283 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1239743791_1 at /127.0.0.1:40758 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_666035179_17 at /127.0.0.1:57684 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:40792 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=389 (was 362) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=3853 (was 4029) 2023-07-13 23:12:18,474 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-13 23:12:18,493 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=181, AvailableMemoryMB=3852 2023-07-13 23:12:18,493 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-13 23:12:18,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:12:18,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:18,498 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:18,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-13 23:12:18,499 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:18,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:18,502 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,502 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,502 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 empty. 2023-07-13 23:12:18,502 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 empty. 2023-07-13 23:12:18,503 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,503 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 23:12:18,520 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:18,521 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b87eadf9c1a657954e75b93a5f83ac7, NAME => 'testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:18,521 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 83f4b2734324156cddfb45490363d0b5, NAME => 'testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 83f4b2734324156cddfb45490363d0b5, disabling compactions & flushes 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 5b87eadf9c1a657954e75b93a5f83ac7, disabling compactions & flushes 2023-07-13 23:12:18,547 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,547 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. after waiting 0 ms 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. after waiting 0 ms 2023-07-13 23:12:18,547 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 83f4b2734324156cddfb45490363d0b5: 2023-07-13 23:12:18,548 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 5b87eadf9c1a657954e75b93a5f83ac7: 2023-07-13 23:12:18,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:18,551 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289938551"}]},"ts":"1689289938551"} 2023-07-13 23:12:18,551 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289938551"}]},"ts":"1689289938551"} 2023-07-13 23:12:18,554 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:18,555 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:18,555 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289938555"}]},"ts":"1689289938555"} 2023-07-13 23:12:18,556 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-13 23:12:18,561 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:18,562 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:18,562 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:18,562 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:18,562 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:18,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, ASSIGN}] 2023-07-13 23:12:18,565 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, ASSIGN 2023-07-13 23:12:18,565 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, ASSIGN 2023-07-13 23:12:18,566 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689289892207; forceNewPlan=false, retain=false 2023-07-13 23:12:18,566 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:12:18,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:18,716 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:18,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5b87eadf9c1a657954e75b93a5f83ac7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:18,719 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=83f4b2734324156cddfb45490363d0b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:18,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938719"}]},"ts":"1689289938719"} 2023-07-13 23:12:18,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289938719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289938719"}]},"ts":"1689289938719"} 2023-07-13 23:12:18,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 5b87eadf9c1a657954e75b93a5f83ac7, server=jenkins-hbase4.apache.org,41069,1689289892207}] 2023-07-13 23:12:18,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 83f4b2734324156cddfb45490363d0b5, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:18,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:18,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b87eadf9c1a657954e75b93a5f83ac7, NAME => 'testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:18,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. service=AccessControlService 2023-07-13 23:12:18,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83f4b2734324156cddfb45490363d0b5, NAME => 'testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:18,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. service=AccessControlService 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,889 INFO [StoreOpener-5b87eadf9c1a657954e75b93a5f83ac7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,889 INFO [StoreOpener-83f4b2734324156cddfb45490363d0b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,890 DEBUG [StoreOpener-5b87eadf9c1a657954e75b93a5f83ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf 2023-07-13 23:12:18,891 DEBUG [StoreOpener-5b87eadf9c1a657954e75b93a5f83ac7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf 2023-07-13 23:12:18,891 DEBUG [StoreOpener-83f4b2734324156cddfb45490363d0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf 2023-07-13 23:12:18,891 DEBUG [StoreOpener-83f4b2734324156cddfb45490363d0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf 2023-07-13 23:12:18,891 INFO [StoreOpener-5b87eadf9c1a657954e75b93a5f83ac7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b87eadf9c1a657954e75b93a5f83ac7 columnFamilyName cf 2023-07-13 23:12:18,891 INFO [StoreOpener-83f4b2734324156cddfb45490363d0b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83f4b2734324156cddfb45490363d0b5 columnFamilyName cf 2023-07-13 23:12:18,892 INFO [StoreOpener-5b87eadf9c1a657954e75b93a5f83ac7-1] regionserver.HStore(310): Store=5b87eadf9c1a657954e75b93a5f83ac7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:18,893 INFO [StoreOpener-83f4b2734324156cddfb45490363d0b5-1] regionserver.HStore(310): Store=83f4b2734324156cddfb45490363d0b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:18,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:18,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:18,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:18,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83f4b2734324156cddfb45490363d0b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74540622, jitterRate=0.11074182391166687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:18,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83f4b2734324156cddfb45490363d0b5: 2023-07-13 23:12:18,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5., pid=46, masterSystemTime=1689289938877 2023-07-13 23:12:18,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:18,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:18,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b87eadf9c1a657954e75b93a5f83ac7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59706195, jitterRate=-0.11030836403369904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:18,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b87eadf9c1a657954e75b93a5f83ac7: 2023-07-13 23:12:18,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7., pid=45, masterSystemTime=1689289938873 2023-07-13 23:12:18,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=83f4b2734324156cddfb45490363d0b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:18,926 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289938926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289938926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289938926"}]},"ts":"1689289938926"} 2023-07-13 23:12:18,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:18,931 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5b87eadf9c1a657954e75b93a5f83ac7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:18,931 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289938931"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289938931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289938931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289938931"}]},"ts":"1689289938931"} 2023-07-13 23:12:18,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-13 23:12:18,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 83f4b2734324156cddfb45490363d0b5, server=jenkins-hbase4.apache.org,40551,1689289892359 in 208 msec 2023-07-13 23:12:18,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, ASSIGN in 371 msec 2023-07-13 23:12:18,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-13 23:12:18,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 5b87eadf9c1a657954e75b93a5f83ac7, server=jenkins-hbase4.apache.org,41069,1689289892207 in 212 msec 2023-07-13 23:12:18,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-13 23:12:18,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, ASSIGN in 374 msec 2023-07-13 23:12:18,948 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:18,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289938948"}]},"ts":"1689289938948"} 2023-07-13 23:12:18,950 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-13 23:12:18,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:18,953 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-13 23:12:18,955 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:18,956 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,956 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,956 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,956 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:18,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:18,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:18,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:18,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:18,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 463 msec 2023-07-13 23:12:19,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 23:12:19,103 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-13 23:12:19,103 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-13 23:12:19,104 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:19,107 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-13 23:12:19,107 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:19,107 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-13 23:12:19,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289939110 (current time:1689289939110). 2023-07-13 23:12:19,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:19,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x17e8fda0 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:19,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553c5fa9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:19,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,121 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17e8fda0 to 127.0.0.1:63267 2023-07-13 23:12:19,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:19,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x5332061d to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:19,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@367f426, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:19,132 DEBUG [hconnection-0x341122f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,135 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,141 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5332061d to 127.0.0.1:63267 2023-07-13 23:12:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:19,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:19,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,149 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,150 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689290539150 2023-07-13 23:12:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 23:12:19,152 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:19,152 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:19,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:19,157 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-13 23:12:19,160 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:19,161 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689290539161 2023-07-13 23:12:19,252 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:19,254 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:19,454 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:19,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:19,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:19,455 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:19,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,587 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-13 23:12:19,587 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,587 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 23:12:19,587 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 23:12:19,588 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,588 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,591 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,591 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,591 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,591 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,591 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,592 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,593 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,594 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,595 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,595 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,599 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,599 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,600 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,600 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,600 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,601 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17cca610[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:19,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17cca610[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:19,606 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 23:12:19,606 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,608 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,608 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:19,609 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:19,609 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:19,609 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. started... 2023-07-13 23:12:19,609 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. started... 2023-07-13 23:12:19,610 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f4b2734324156cddfb45490363d0b5: 2023-07-13 23:12:19,610 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b87eadf9c1a657954e75b93a5f83ac7: 2023-07-13 23:12:19,610 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,610 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,610 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:19,611 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:19,611 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:19,611 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:19,617 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,617 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,617 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,641 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. completed. 2023-07-13 23:12:19,641 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:19,641 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:19,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,643 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,644 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,648 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. completed. 2023-07-13 23:12:19,648 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:19,648 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:19,649 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:19,649 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,649 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,649 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:19,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41069,1689289892207': 2023-07-13 23:12:19,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 23:12:19,650 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,650 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,650 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,651 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:19,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 23:12:19,655 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-13 23:12:19,655 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:19,655 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:19,655 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,655 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,657 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,658 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,658 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,659 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,660 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,660 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,661 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,665 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,665 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,665 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,667 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,667 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,667 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,668 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,668 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,668 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,668 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 23:12:19,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,712 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:19,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689289939151Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689289939665 (+514 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689289939667 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689289939671 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689289939682 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689289939712 (+30 ms) 2023-07-13 23:12:19,715 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:19,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 563 msec 2023-07-13 23:12:19,755 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:19,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:19,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:19,763 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,767 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:19,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41069] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:19,771 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 23:12:19,771 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:19,772 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:19,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289939784 (current time:1689289939784). 2023-07-13 23:12:19,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:19,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x4bf45411 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:19,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bae44da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:19,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,800 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bf45411 to 127.0.0.1:63267 2023-07-13 23:12:19,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:19,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x1a5d605d to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:19,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73e0ebdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:19,809 DEBUG [hconnection-0x7ae1e9e9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,811 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:19,817 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:19,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a5d605d to 127.0.0.1:63267 2023-07-13 23:12:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 23:12:19,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:19,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,823 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,824 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689290539824 2023-07-13 23:12:19,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 23:12:19,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 23:12:19,825 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:19,825 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:19,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:19,826 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 23:12:19,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-13 23:12:19,829 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:19,830 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689290539830 2023-07-13 23:12:19,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-13 23:12:19,869 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-13 23:12:19,869 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,871 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 23:12:19,871 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 23:12:19,871 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,871 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,873 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,873 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,873 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,873 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,873 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,873 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 23:12:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 23:12:19,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:19,879 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,879 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:19,883 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,885 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 23:12:19,905 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 23:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 23:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 23:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 23:12:19,915 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,915 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,916 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,916 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,916 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,916 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,917 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,917 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,917 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,917 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c66bad9[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 23:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c66bad9[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:19,922 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 23:12:19,922 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,924 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:19,924 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:19,924 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:19,924 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. started... 2023-07-13 23:12:19,924 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. started... 2023-07-13 23:12:19,925 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:19,925 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:19,925 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b87eadf9c1a657954e75b93a5f83ac7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 23:12:19,925 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83f4b2734324156cddfb45490363d0b5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 23:12:19,925 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:19,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:19,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:19,927 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:19,927 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,927 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,928 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,949 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/.tmp/cf/d8589b86b8814f51b6ecb303e62cd194 2023-07-13 23:12:19,950 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/.tmp/cf/3916fea41a8c4d2c9afd59db48cf6689 2023-07-13 23:12:19,957 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/.tmp/cf/d8589b86b8814f51b6ecb303e62cd194 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194 2023-07-13 23:12:19,957 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/.tmp/cf/3916fea41a8c4d2c9afd59db48cf6689 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689 2023-07-13 23:12:19,963 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194, entries=4, sequenceid=6, filesize=5.1 K 2023-07-13 23:12:19,964 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5b87eadf9c1a657954e75b93a5f83ac7 in 39ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:19,964 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-13 23:12:19,964 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689, entries=46, sequenceid=6, filesize=7.9 K 2023-07-13 23:12:19,964 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b87eadf9c1a657954e75b93a5f83ac7: 2023-07-13 23:12:19,964 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:19,964 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:19,965 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194] hfiles 2023-07-13 23:12:19,965 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:19,965 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 83f4b2734324156cddfb45490363d0b5 in 40ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:19,967 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f4b2734324156cddfb45490363d0b5: 2023-07-13 23:12:19,967 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:19,967 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:19,967 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689] hfiles 2023-07-13 23:12:19,967 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 23:12:19,983 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. completed. 2023-07-13 23:12:19,983 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:19,985 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,986 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. completed. 2023-07-13 23:12:19,986 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,987 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:19,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,987 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:19,987 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:19,987 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,987 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 23:12:19,987 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,989 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,989 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 23:12:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,989 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:19,989 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 23:12:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41069,1689289892207': 2023-07-13 23:12:19,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 23:12:19,995 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-13 23:12:19,995 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:19,995 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:19,995 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-13 23:12:19,995 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:19,998 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:19,997 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:19,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,998 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:19,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,999 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:20,001 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:20,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 23:12:20,001 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:20,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:20,001 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:20,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:20,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:20,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,008 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:20,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:20,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:20,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-13 23:12:20,008 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:20,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-13 23:12:20,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:20,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:20,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:20,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,010 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,011 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:20,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:20,011 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:20,011 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,011 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 23:12:20,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,053 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689289939824Consolidate snapshot: snaptb0-testConsecutiveExports at 1689289940010 (+186 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689289940010Writing data manifest for snaptb0-testConsecutiveExports at 1689289940015 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689289940024 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689289940052 (+28 ms) 2023-07-13 23:12:20,055 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 23:12:20,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 230 msec 2023-07-13 23:12:20,127 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:20,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 23:12:20,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:20,129 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129 2023-07-13 23:12:20,129 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:20,156 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:20,156 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@61bde85a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,156 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 23:12:20,167 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:20,190 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,190 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,191 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:20,191 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,148 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-2777613181373057902.jar 2023-07-13 23:12:21,148 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,149 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,217 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-6118418120604041959.jar 2023-07-13 23:12:21,217 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,218 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,218 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,219 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,219 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,219 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:21,220 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:21,220 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:21,220 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:21,221 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:21,221 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:21,223 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:21,223 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:21,224 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,224 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,225 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:21,225 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,225 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:21,226 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:21,226 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:22,099 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:22,102 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 23:12:22,104 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 23:12:22,504 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:22,504 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:22,507 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0002_000001 (auth:SIMPLE) 2023-07-13 23:12:23,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:23,788 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:12:27,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:29,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:32,774 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:34,305 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:34,306 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:34,309 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 23:12:34,309 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:34,310 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@34796b06 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:34,313 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:34,314 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:34,337 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:34,337 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@20e55816, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:34,337 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 23:12:34,345 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 23:12:34,357 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:34,357 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:34,358 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:34,358 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-2931638942651786900.jar 2023-07-13 23:12:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-5846995612458299998.jar 2023-07-13 23:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,323 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,324 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,324 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,325 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,325 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:35,325 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:35,326 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:35,326 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:35,326 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:35,327 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:35,327 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:35,329 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:35,329 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:35,330 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:35,330 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:35,330 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:35,331 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:35,331 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:35,332 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:35,729 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:35,732 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 23:12:35,734 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 23:12:38,948 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:38,948 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:38,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0003_000001 (auth:SIMPLE) 2023-07-13 23:12:39,729 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:44,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:46,536 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:49,857 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:50,957 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:12:50,958 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:12:50,963 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 23:12:50,964 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:12:50,964 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:12:50,964 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@34796b06 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 23:12:50,970 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 23:12:50,970 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/local-export-1689289940129/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 23:12:50,989 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-13 23:12:50,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-13 23:12:50,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:50,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289970996"}]},"ts":"1689289970996"} 2023-07-13 23:12:50,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:50,997 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-13 23:12:50,999 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-13 23:12:51,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, UNASSIGN}] 2023-07-13 23:12:51,003 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, UNASSIGN 2023-07-13 23:12:51,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, UNASSIGN 2023-07-13 23:12:51,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=83f4b2734324156cddfb45490363d0b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:51,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289971004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289971004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289971004"}]},"ts":"1689289971004"} 2023-07-13 23:12:51,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 83f4b2734324156cddfb45490363d0b5, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:51,010 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5b87eadf9c1a657954e75b93a5f83ac7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:51,010 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289971010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289971010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289971010"}]},"ts":"1689289971010"} 2023-07-13 23:12:51,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 5b87eadf9c1a657954e75b93a5f83ac7, server=jenkins-hbase4.apache.org,41069,1689289892207}] 2023-07-13 23:12:51,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:51,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:51,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83f4b2734324156cddfb45490363d0b5, disabling compactions & flushes 2023-07-13 23:12:51,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:51,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:51,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. after waiting 0 ms 2023-07-13 23:12:51,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:51,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:51,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b87eadf9c1a657954e75b93a5f83ac7, disabling compactions & flushes 2023-07-13 23:12:51,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:51,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:51,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. after waiting 0 ms 2023-07-13 23:12:51,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:51,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:51,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:12:51,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:51,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:51,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7. 2023-07-13 23:12:51,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b87eadf9c1a657954e75b93a5f83ac7: 2023-07-13 23:12:51,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5. 2023-07-13 23:12:51,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83f4b2734324156cddfb45490363d0b5: 2023-07-13 23:12:51,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:51,228 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=83f4b2734324156cddfb45490363d0b5, regionState=CLOSED 2023-07-13 23:12:51,228 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289971228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289971228"}]},"ts":"1689289971228"} 2023-07-13 23:12:51,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:51,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5b87eadf9c1a657954e75b93a5f83ac7, regionState=CLOSED 2023-07-13 23:12:51,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689289971229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289971229"}]},"ts":"1689289971229"} 2023-07-13 23:12:51,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-13 23:12:51,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 83f4b2734324156cddfb45490363d0b5, server=jenkins-hbase4.apache.org,40551,1689289892359 in 221 msec 2023-07-13 23:12:51,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-13 23:12:51,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 5b87eadf9c1a657954e75b93a5f83ac7, server=jenkins-hbase4.apache.org,41069,1689289892207 in 217 msec 2023-07-13 23:12:51,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=83f4b2734324156cddfb45490363d0b5, UNASSIGN in 247 msec 2023-07-13 23:12:51,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-13 23:12:51,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b87eadf9c1a657954e75b93a5f83ac7, UNASSIGN in 248 msec 2023-07-13 23:12:51,256 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289971256"}]},"ts":"1689289971256"} 2023-07-13 23:12:51,258 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-13 23:12:51,260 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-13 23:12:51,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 271 msec 2023-07-13 23:12:51,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 23:12:51,300 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-13 23:12:51,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-13 23:12:51,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,305 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-13 23:12:51,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,310 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-13 23:12:51,313 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,313 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,314 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,313 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:51,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:51,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 23:12:51,315 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 23:12:51,316 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:51,317 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-13 23:12:51,317 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:12:51,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 23:12:51,322 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:51,322 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:51,325 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/recovered.edits] 2023-07-13 23:12:51,325 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/recovered.edits] 2023-07-13 23:12:51,353 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/cf/d8589b86b8814f51b6ecb303e62cd194 2023-07-13 23:12:51,354 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/cf/3916fea41a8c4d2c9afd59db48cf6689 2023-07-13 23:12:51,359 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5/recovered.edits/9.seqid 2023-07-13 23:12:51,359 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/83f4b2734324156cddfb45490363d0b5 2023-07-13 23:12:51,361 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7/recovered.edits/9.seqid 2023-07-13 23:12:51,361 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testConsecutiveExports/5b87eadf9c1a657954e75b93a5f83ac7 2023-07-13 23:12:51,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 23:12:51,364 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,368 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-13 23:12:51,381 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-13 23:12:51,383 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,383 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-13 23:12:51,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289971383"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:51,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289971383"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:51,393 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:12:51,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b87eadf9c1a657954e75b93a5f83ac7, NAME => 'testtb-testConsecutiveExports,,1689289938494.5b87eadf9c1a657954e75b93a5f83ac7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83f4b2734324156cddfb45490363d0b5, NAME => 'testtb-testConsecutiveExports,1,1689289938494.83f4b2734324156cddfb45490363d0b5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:12:51,393 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-13 23:12:51,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289971393"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:51,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-13 23:12:51,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 23:12:51,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 107 msec 2023-07-13 23:12:51,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 23:12:51,419 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-13 23:12:51,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-13 23:12:51,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-13 23:12:51,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-13 23:12:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-13 23:12:51,483 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 764), OpenFileDescriptor=897 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=424 (was 389) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3674 (was 3852) 2023-07-13 23:12:51,484 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-13 23:12:51,516 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=424, ProcessCount=186, AvailableMemoryMB=3670 2023-07-13 23:12:51,516 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-13 23:12:51,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:12:51,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:51,523 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:51,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-13 23:12:51,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:51,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:51,531 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:51,531 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:51,531 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 empty. 2023-07-13 23:12:51,532 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c empty. 2023-07-13 23:12:51,532 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:51,532 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:51,532 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 23:12:51,568 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:51,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => feb0caf9d83c9f64098df10036a4f78c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:51,579 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c1c1605b57aab2d3aabff29fca450f89, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:51,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:51,666 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:51,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing feb0caf9d83c9f64098df10036a4f78c, disabling compactions & flushes 2023-07-13 23:12:51,667 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:51,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:51,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. after waiting 0 ms 2023-07-13 23:12:51,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:51,667 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:51,667 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for feb0caf9d83c9f64098df10036a4f78c: 2023-07-13 23:12:51,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:51,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c1c1605b57aab2d3aabff29fca450f89, disabling compactions & flushes 2023-07-13 23:12:51,682 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:51,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:51,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. after waiting 0 ms 2023-07-13 23:12:51,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:51,682 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:51,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c1c1605b57aab2d3aabff29fca450f89: 2023-07-13 23:12:51,687 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:51,688 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289971688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289971688"}]},"ts":"1689289971688"} 2023-07-13 23:12:51,688 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289971688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289971688"}]},"ts":"1689289971688"} 2023-07-13 23:12:51,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:51,704 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:51,704 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289971704"}]},"ts":"1689289971704"} 2023-07-13 23:12:51,706 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-13 23:12:51,713 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:51,716 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:51,716 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:51,716 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:51,716 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:51,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, ASSIGN}] 2023-07-13 23:12:51,725 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, ASSIGN 2023-07-13 23:12:51,726 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:12:51,727 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, ASSIGN 2023-07-13 23:12:51,728 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689289892207; forceNewPlan=false, retain=false 2023-07-13 23:12:51,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:51,879 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:51,882 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c1c1605b57aab2d3aabff29fca450f89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:51,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289971882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289971882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289971882"}]},"ts":"1689289971882"} 2023-07-13 23:12:51,883 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=feb0caf9d83c9f64098df10036a4f78c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:51,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289971883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289971883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289971883"}]},"ts":"1689289971883"} 2023-07-13 23:12:51,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure c1c1605b57aab2d3aabff29fca450f89, server=jenkins-hbase4.apache.org,41069,1689289892207}] 2023-07-13 23:12:51,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure feb0caf9d83c9f64098df10036a4f78c, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:52,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:52,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1c1605b57aab2d3aabff29fca450f89, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:12:52,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. service=AccessControlService 2023-07-13 23:12:52,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:52,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:52,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,051 INFO [StoreOpener-c1c1605b57aab2d3aabff29fca450f89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,054 DEBUG [StoreOpener-c1c1605b57aab2d3aabff29fca450f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf 2023-07-13 23:12:52,054 DEBUG [StoreOpener-c1c1605b57aab2d3aabff29fca450f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf 2023-07-13 23:12:52,056 INFO [StoreOpener-c1c1605b57aab2d3aabff29fca450f89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1c1605b57aab2d3aabff29fca450f89 columnFamilyName cf 2023-07-13 23:12:52,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:52,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => feb0caf9d83c9f64098df10036a4f78c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:12:52,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. service=AccessControlService 2023-07-13 23:12:52,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:52,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:52,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,059 INFO [StoreOpener-c1c1605b57aab2d3aabff29fca450f89-1] regionserver.HStore(310): Store=c1c1605b57aab2d3aabff29fca450f89/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:52,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,063 INFO [StoreOpener-feb0caf9d83c9f64098df10036a4f78c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,064 DEBUG [StoreOpener-feb0caf9d83c9f64098df10036a4f78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf 2023-07-13 23:12:52,065 DEBUG [StoreOpener-feb0caf9d83c9f64098df10036a4f78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf 2023-07-13 23:12:52,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:12:52,065 INFO [StoreOpener-feb0caf9d83c9f64098df10036a4f78c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb0caf9d83c9f64098df10036a4f78c columnFamilyName cf 2023-07-13 23:12:52,066 INFO [StoreOpener-feb0caf9d83c9f64098df10036a4f78c-1] regionserver.HStore(310): Store=feb0caf9d83c9f64098df10036a4f78c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:52,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:52,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:12:52,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1c1605b57aab2d3aabff29fca450f89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62170816, jitterRate=-0.07358264923095703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:52,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1c1605b57aab2d3aabff29fca450f89: 2023-07-13 23:12:52,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89., pid=60, masterSystemTime=1689289972040 2023-07-13 23:12:52,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:52,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened feb0caf9d83c9f64098df10036a4f78c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70536563, jitterRate=0.05107669532299042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:52,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for feb0caf9d83c9f64098df10036a4f78c: 2023-07-13 23:12:52,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:52,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:52,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c., pid=61, masterSystemTime=1689289972046 2023-07-13 23:12:52,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c1c1605b57aab2d3aabff29fca450f89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289972078"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289972078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289972078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289972078"}]},"ts":"1689289972078"} 2023-07-13 23:12:52,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:52,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:52,082 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=feb0caf9d83c9f64098df10036a4f78c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289972082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289972082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289972082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289972082"}]},"ts":"1689289972082"} 2023-07-13 23:12:52,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-13 23:12:52,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure c1c1605b57aab2d3aabff29fca450f89, server=jenkins-hbase4.apache.org,41069,1689289892207 in 193 msec 2023-07-13 23:12:52,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-13 23:12:52,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure feb0caf9d83c9f64098df10036a4f78c, server=jenkins-hbase4.apache.org,40551,1689289892359 in 195 msec 2023-07-13 23:12:52,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, ASSIGN in 369 msec 2023-07-13 23:12:52,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-13 23:12:52,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, ASSIGN in 372 msec 2023-07-13 23:12:52,095 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:52,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289972095"}]},"ts":"1689289972095"} 2023-07-13 23:12:52,099 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-13 23:12:52,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:52,170 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:52,170 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-13 23:12:52,173 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:52,247 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:52,247 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:52,247 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:52,247 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:52,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:52,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:52,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:52,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:52,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 820 msec 2023-07-13 23:12:52,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 23:12:52,642 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-13 23:12:52,642 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-13 23:12:52,642 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:52,646 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-13 23:12:52,646 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:52,647 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-13 23:12:52,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:52,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289972650 (current time:1689289972650). 2023-07-13 23:12:52,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:52,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x23038627 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:52,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b8fb7dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:52,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:52,693 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:52,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23038627 to 127.0.0.1:63267 2023-07-13 23:12:52,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:52,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x52778853 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:52,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d7a0e84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:52,735 DEBUG [hconnection-0x5bfd65a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:52,736 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:52,736 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:52,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:52,746 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:52,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52778853 to 127.0.0.1:63267 2023-07-13 23:12:52,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:52,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:52,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:52,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:52,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:52,770 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:52,771 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689290572771 2023-07-13 23:12:52,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:52,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,772 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:52,772 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:52,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:52,785 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:52,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 28 msec 2023-07-13 23:12:52,788 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:52,788 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689290572788 2023-07-13 23:12:52,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,823 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:52,823 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:52,824 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 23:12:52,824 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 23:12:52,858 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,859 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,860 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,860 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,860 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,860 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,861 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,861 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,862 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,862 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:52,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,865 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:52,865 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:52,865 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:52,865 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:52,865 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:52,870 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:52,871 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,872 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:52,873 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65c138e4[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:52,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:52,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65c138e4[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:52,879 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 23:12:52,879 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:52,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:52,881 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,881 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:52,881 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:52,881 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. started... 2023-07-13 23:12:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:52,881 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:52,883 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1c1605b57aab2d3aabff29fca450f89: 2023-07-13 23:12:52,883 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. started... 2023-07-13 23:12:52,883 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feb0caf9d83c9f64098df10036a4f78c: 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:52,884 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:12:52,888 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:52,888 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:52,888 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:52,907 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. completed. 2023-07-13 23:12:52,907 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:52,907 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:52,907 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:52,907 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,907 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:52,907 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:52,909 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:52,909 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,909 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:52,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:52,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:52,909 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:52,910 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. completed. 2023-07-13 23:12:52,910 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:52,910 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:52,911 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:52,911 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:52,911 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:52,911 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:52,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:52,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,912 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,912 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:52,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,912 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:52,913 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:52,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:52,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:52,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:52,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41069,1689289892207': 2023-07-13 23:12:52,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 23:12:52,931 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 23:12:52,932 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:52,932 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:52,932 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,932 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:52,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,934 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:52,935 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,936 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:52,937 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,940 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,940 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,941 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:52,945 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,945 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:52,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,944 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:52,944 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:52,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:52,945 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:52,945 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,946 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:52,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 23:12:53,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,052 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689289972772Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289972945 (+173 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289972945Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289972976 (+31 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689289972995 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689289973051 (+56 ms) 2023-07-13 23:12:53,055 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:53,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 281 msec 2023-07-13 23:12:53,074 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:53,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:53,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:53,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41069] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:12:53,107 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,107 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:53,107 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:12:53,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289973125 (current time:1689289973125). 2023-07-13 23:12:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:53,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x36958e9e to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:53,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a2913e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:53,153 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36958e9e to 127.0.0.1:63267 2023-07-13 23:12:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x2e8028f0 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:53,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@347ba2c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:53,183 DEBUG [hconnection-0x760f11bc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:53,187 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:53,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:53,192 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:53,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e8028f0 to 127.0.0.1:63267 2023-07-13 23:12:53,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:53,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 23:12:53,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:53,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:53,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:53,198 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:53,199 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689290573199 2023-07-13 23:12:53,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 23:12:53,200 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:53,201 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:53,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:53,202 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 23:12:53,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-13 23:12:53,206 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:53,207 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689290573207 2023-07-13 23:12:53,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,271 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 23:12:53,271 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:53,273 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 23:12:53,273 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 23:12:53,273 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,273 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,275 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,276 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,276 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:53,277 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 23:12:53,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,299 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:53,299 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:53,301 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:53,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:53,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:53,302 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:53,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,312 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:53,312 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 23:12:53,312 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:53,312 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:53,312 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:53,315 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 23:12:53,315 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 23:12:53,316 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 23:12:53,317 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,317 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,318 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:53,318 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:53,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:53,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66c9a4d3[Count = 1] remaining members to acquire global barrier 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:53,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 23:12:53,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66c9a4d3[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:53,323 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 23:12:53,323 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,324 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,324 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:53,325 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:53,325 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:53,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,325 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:53,325 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 23:12:53,326 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,326 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:53,326 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:53,326 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:53,326 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. started... 2023-07-13 23:12:53,326 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. started... 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:53,326 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:53,328 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c1c1605b57aab2d3aabff29fca450f89 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-13 23:12:53,329 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing feb0caf9d83c9f64098df10036a4f78c 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-13 23:12:53,359 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/.tmp/cf/8d15f84275ea4a009096e901c28aaa99 2023-07-13 23:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/.tmp/cf/8d15f84275ea4a009096e901c28aaa99 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99 2023-07-13 23:12:53,380 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/.tmp/cf/675d2070365a4e5ca5717363f43efca5 2023-07-13 23:12:53,384 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99, entries=47, sequenceid=6, filesize=8.0 K 2023-07-13 23:12:53,386 INFO [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c1c1605b57aab2d3aabff29fca450f89 in 60ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c1c1605b57aab2d3aabff29fca450f89: 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99] hfiles 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/.tmp/cf/675d2070365a4e5ca5717363f43efca5 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5 2023-07-13 23:12:53,388 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,394 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5, entries=3, sequenceid=6, filesize=5.0 K 2023-07-13 23:12:53,432 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for feb0caf9d83c9f64098df10036a4f78c in 103ms, sequenceid=6, compaction requested=false 2023-07-13 23:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feb0caf9d83c9f64098df10036a4f78c: 2023-07-13 23:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5] hfiles 2023-07-13 23:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,494 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. completed. 2023-07-13 23:12:53,494 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689289892207)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:12:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:53,502 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:53,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:53,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:53,504 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:53,530 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:53,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:53,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41069,1689289892207': 2023-07-13 23:12:53,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 23:12:53,567 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. completed. 2023-07-13 23:12:53,567 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:12:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 23:12:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:53,607 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,607 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 23:12:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:53,607 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:53,607 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 23:12:53,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:12:53,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 23:12:53,622 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 23:12:53,622 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:53,622 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:53,622 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,622 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:53,673 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,673 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,676 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,677 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,677 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,679 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:53,679 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:53,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,680 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,682 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,692 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,700 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,700 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,700 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,700 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,702 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:53,703 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:53,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:53,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,704 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:53,704 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:53,706 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:53,706 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,706 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,704 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-13 23:12:53,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,804 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:53,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:53,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:53,806 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:12:53,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 23:12:53,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,904 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:12:53,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689289973199Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689289973707 (+508 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689289973707Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689289973714 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689289973775 (+61 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689289973903 (+128 ms) 2023-07-13 23:12:53,907 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 23:12:53,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 707 msec 2023-07-13 23:12:54,306 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:54,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 23:12:54,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:54,346 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:54,352 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:54,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:54,355 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:54,359 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:54,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41069] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:54,360 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 23:12:54,365 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 23:12:54,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45125] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 23:12:54,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:12:54,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:54,374 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:12:54,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-13 23:12:54,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:12:54,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:54,379 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,379 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,379 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 empty. 2023-07-13 23:12:54,380 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 empty. 2023-07-13 23:12:54,380 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,380 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,380 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 23:12:54,398 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-13 23:12:54,400 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa5e829568eb99b1b9d2d8f354259106, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:54,400 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d4193cb47f9f692d22cd86cdb772487, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5d4193cb47f9f692d22cd86cdb772487, disabling compactions & flushes 2023-07-13 23:12:54,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. after waiting 0 ms 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5d4193cb47f9f692d22cd86cdb772487: 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing fa5e829568eb99b1b9d2d8f354259106, disabling compactions & flushes 2023-07-13 23:12:54,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. after waiting 0 ms 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for fa5e829568eb99b1b9d2d8f354259106: 2023-07-13 23:12:54,432 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:12:54,433 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289974433"}]},"ts":"1689289974433"} 2023-07-13 23:12:54,433 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289974433"}]},"ts":"1689289974433"} 2023-07-13 23:12:54,438 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:12:54,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:12:54,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289974446"}]},"ts":"1689289974446"} 2023-07-13 23:12:54,447 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-13 23:12:54,453 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:12:54,454 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:12:54,454 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:12:54,454 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:12:54,454 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:12:54,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, ASSIGN}] 2023-07-13 23:12:54,458 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, ASSIGN 2023-07-13 23:12:54,458 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, ASSIGN 2023-07-13 23:12:54,459 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:12:54,459 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:12:54,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:54,609 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:12:54,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5d4193cb47f9f692d22cd86cdb772487, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:54,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fa5e829568eb99b1b9d2d8f354259106, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:54,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289974613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289974613"}]},"ts":"1689289974613"} 2023-07-13 23:12:54,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289974613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289974613"}]},"ts":"1689289974613"} 2023-07-13 23:12:54,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 5d4193cb47f9f692d22cd86cdb772487, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:54,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure fa5e829568eb99b1b9d2d8f354259106, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:54,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:54,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa5e829568eb99b1b9d2d8f354259106, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.', STARTKEY => '2', ENDKEY => ''} 2023-07-13 23:12:54,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. service=AccessControlService 2023-07-13 23:12:54,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:54,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d4193cb47f9f692d22cd86cdb772487, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.', STARTKEY => '', ENDKEY => '2'} 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. service=AccessControlService 2023-07-13 23:12:54,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,783 INFO [StoreOpener-fa5e829568eb99b1b9d2d8f354259106-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,783 INFO [StoreOpener-5d4193cb47f9f692d22cd86cdb772487-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,785 DEBUG [StoreOpener-fa5e829568eb99b1b9d2d8f354259106-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf 2023-07-13 23:12:54,785 DEBUG [StoreOpener-fa5e829568eb99b1b9d2d8f354259106-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf 2023-07-13 23:12:54,785 DEBUG [StoreOpener-5d4193cb47f9f692d22cd86cdb772487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf 2023-07-13 23:12:54,785 DEBUG [StoreOpener-5d4193cb47f9f692d22cd86cdb772487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf 2023-07-13 23:12:54,785 INFO [StoreOpener-fa5e829568eb99b1b9d2d8f354259106-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa5e829568eb99b1b9d2d8f354259106 columnFamilyName cf 2023-07-13 23:12:54,785 INFO [StoreOpener-5d4193cb47f9f692d22cd86cdb772487-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d4193cb47f9f692d22cd86cdb772487 columnFamilyName cf 2023-07-13 23:12:54,786 INFO [StoreOpener-fa5e829568eb99b1b9d2d8f354259106-1] regionserver.HStore(310): Store=fa5e829568eb99b1b9d2d8f354259106/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:54,786 INFO [StoreOpener-5d4193cb47f9f692d22cd86cdb772487-1] regionserver.HStore(310): Store=5d4193cb47f9f692d22cd86cdb772487/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:54,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:54,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:54,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:54,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa5e829568eb99b1b9d2d8f354259106; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67562982, jitterRate=0.00676688551902771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:54,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa5e829568eb99b1b9d2d8f354259106: 2023-07-13 23:12:54,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:12:54,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106., pid=70, masterSystemTime=1689289974772 2023-07-13 23:12:54,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d4193cb47f9f692d22cd86cdb772487; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62213281, jitterRate=-0.07294987142086029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:54,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d4193cb47f9f692d22cd86cdb772487: 2023-07-13 23:12:54,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487., pid=69, masterSystemTime=1689289974770 2023-07-13 23:12:54,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:54,796 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fa5e829568eb99b1b9d2d8f354259106, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:54,796 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974796"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289974796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289974796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289974796"}]},"ts":"1689289974796"} 2023-07-13 23:12:54,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:54,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5d4193cb47f9f692d22cd86cdb772487, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:54,797 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289974797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289974797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289974797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289974797"}]},"ts":"1689289974797"} 2023-07-13 23:12:54,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-13 23:12:54,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure fa5e829568eb99b1b9d2d8f354259106, server=jenkins-hbase4.apache.org,40551,1689289892359 in 180 msec 2023-07-13 23:12:54,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-13 23:12:54,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 5d4193cb47f9f692d22cd86cdb772487, server=jenkins-hbase4.apache.org,45125,1689289892301 in 182 msec 2023-07-13 23:12:54,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, ASSIGN in 345 msec 2023-07-13 23:12:54,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-13 23:12:54,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, ASSIGN in 346 msec 2023-07-13 23:12:54,804 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:12:54,804 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289974804"}]},"ts":"1689289974804"} 2023-07-13 23:12:54,805 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-13 23:12:54,808 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:12:54,809 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-13 23:12:54,811 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 23:12:54,813 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,813 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,813 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,813 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:12:54,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 23:12:54,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 448 msec 2023-07-13 23:12:54,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 23:12:54,980 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-13 23:12:55,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:55,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106], force=true 2023-07-13 23:12:55,012 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106], force=true 2023-07-13 23:12:55,012 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106], force=true 2023-07-13 23:12:55,012 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106], force=true 2023-07-13 23:12:55,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:55,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, UNASSIGN}] 2023-07-13 23:12:55,035 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, UNASSIGN 2023-07-13 23:12:55,036 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, UNASSIGN 2023-07-13 23:12:55,036 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5d4193cb47f9f692d22cd86cdb772487, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:55,036 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fa5e829568eb99b1b9d2d8f354259106, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:55,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289975036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289975036"}]},"ts":"1689289975036"} 2023-07-13 23:12:55,037 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289975036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289975036"}]},"ts":"1689289975036"} 2023-07-13 23:12:55,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 5d4193cb47f9f692d22cd86cdb772487, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:55,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure fa5e829568eb99b1b9d2d8f354259106, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:12:55,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:55,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:55,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:55,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d4193cb47f9f692d22cd86cdb772487, disabling compactions & flushes 2023-07-13 23:12:55,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:55,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:55,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. after waiting 0 ms 2023-07-13 23:12:55,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:55,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5d4193cb47f9f692d22cd86cdb772487 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 23:12:55,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa5e829568eb99b1b9d2d8f354259106, disabling compactions & flushes 2023-07-13 23:12:55,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:55,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:55,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. after waiting 0 ms 2023-07-13 23:12:55,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:55,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fa5e829568eb99b1b9d2d8f354259106 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 23:12:55,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/.tmp/cf/09679dc8e1b64e4a8423c0cdf4aeed8c 2023-07-13 23:12:55,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/.tmp/cf/ae543494de87483399438c503ffe3161 2023-07-13 23:12:55,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/.tmp/cf/09679dc8e1b64e4a8423c0cdf4aeed8c as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c 2023-07-13 23:12:55,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/.tmp/cf/ae543494de87483399438c503ffe3161 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161 2023-07-13 23:12:55,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 23:12:55,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5d4193cb47f9f692d22cd86cdb772487 in 52ms, sequenceid=5, compaction requested=false 2023-07-13 23:12:55,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 23:12:55,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 23:12:55,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 23:12:55,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:55,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487. 2023-07-13 23:12:55,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d4193cb47f9f692d22cd86cdb772487: 2023-07-13 23:12:55,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fa5e829568eb99b1b9d2d8f354259106 in 64ms, sequenceid=5, compaction requested=false 2023-07-13 23:12:55,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:12:55,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5d4193cb47f9f692d22cd86cdb772487, regionState=CLOSED 2023-07-13 23:12:55,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289975264"}]},"ts":"1689289975264"} 2023-07-13 23:12:55,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 23:12:55,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:12:55,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106. 2023-07-13 23:12:55,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa5e829568eb99b1b9d2d8f354259106: 2023-07-13 23:12:55,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:12:55,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-13 23:12:55,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 5d4193cb47f9f692d22cd86cdb772487, server=jenkins-hbase4.apache.org,45125,1689289892301 in 228 msec 2023-07-13 23:12:55,271 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fa5e829568eb99b1b9d2d8f354259106, regionState=CLOSED 2023-07-13 23:12:55,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689289975271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289975271"}]},"ts":"1689289975271"} 2023-07-13 23:12:55,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d4193cb47f9f692d22cd86cdb772487, UNASSIGN in 240 msec 2023-07-13 23:12:55,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-13 23:12:55,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure fa5e829568eb99b1b9d2d8f354259106, server=jenkins-hbase4.apache.org,40551,1689289892359 in 234 msec 2023-07-13 23:12:55,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-13 23:12:55,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fa5e829568eb99b1b9d2d8f354259106, UNASSIGN in 241 msec 2023-07-13 23:12:55,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:55,365 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-13 23:12:55,368 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974367.5d4193cb47f9f692d22cd86cdb772487.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:55,368 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689289974367.fa5e829568eb99b1b9d2d8f354259106.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:55,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 23:12:55,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, ASSIGN}] 2023-07-13 23:12:55,437 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, ASSIGN 2023-07-13 23:12:55,438 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:12:55,589 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 23:12:55,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=715ad825d882603bb1c2c74526143efa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:55,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289975590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289975590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289975590"}]},"ts":"1689289975590"} 2023-07-13 23:12:55,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 715ad825d882603bb1c2c74526143efa, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:12:55,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:55,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:12:55,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 715ad825d882603bb1c2c74526143efa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.', STARTKEY => '', ENDKEY => ''} 2023-07-13 23:12:55,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. service=AccessControlService 2023-07-13 23:12:55,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:12:55,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:12:55,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/.regioninfo 2023-07-13 23:12:55,764 INFO [StoreOpener-715ad825d882603bb1c2c74526143efa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,765 DEBUG [StoreOpener-715ad825d882603bb1c2c74526143efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf 2023-07-13 23:12:55,765 DEBUG [StoreOpener-715ad825d882603bb1c2c74526143efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf 2023-07-13 23:12:55,765 INFO [StoreOpener-715ad825d882603bb1c2c74526143efa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 715ad825d882603bb1c2c74526143efa columnFamilyName cf 2023-07-13 23:12:55,798 DEBUG [StoreOpener-715ad825d882603bb1c2c74526143efa-1] regionserver.HStore(539): loaded hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/09679dc8e1b64e4a8423c0cdf4aeed8c.fa5e829568eb99b1b9d2d8f354259106->hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c-top 2023-07-13 23:12:55,805 DEBUG [StoreOpener-715ad825d882603bb1c2c74526143efa-1] regionserver.HStore(539): loaded hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/ae543494de87483399438c503ffe3161.5d4193cb47f9f692d22cd86cdb772487->hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161-top 2023-07-13 23:12:55,806 INFO [StoreOpener-715ad825d882603bb1c2c74526143efa-1] regionserver.HStore(310): Store=715ad825d882603bb1c2c74526143efa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:12:55,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 715ad825d882603bb1c2c74526143efa 2023-07-13 23:12:55,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 715ad825d882603bb1c2c74526143efa; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67055465, jitterRate=-7.95707106590271E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:12:55,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 715ad825d882603bb1c2c74526143efa: 2023-07-13 23:12:55,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa., pid=77, masterSystemTime=1689289975747 2023-07-13 23:12:55,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.,because compaction is disabled. 2023-07-13 23:12:55,818 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=715ad825d882603bb1c2c74526143efa, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:55,818 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289975818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289975818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289975818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289975818"}]},"ts":"1689289975818"} 2023-07-13 23:12:55,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:12:55,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:12:55,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-13 23:12:55,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 715ad825d882603bb1c2c74526143efa, server=jenkins-hbase4.apache.org,45125,1689289892301 in 228 msec 2023-07-13 23:12:55,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-13 23:12:55,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, ASSIGN in 387 msec 2023-07-13 23:12:55,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d4193cb47f9f692d22cd86cdb772487, fa5e829568eb99b1b9d2d8f354259106], force=true in 820 msec 2023-07-13 23:12:56,067 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0004_000001 (auth:SIMPLE) 2023-07-13 23:12:56,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 23:12:56,120 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-13 23:12:56,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:56,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289976121 (current time:1689289976121). 2023-07-13 23:12:56,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:12:56,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x400d2cc1 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:56,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e34ed96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:56,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:56,132 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:56,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x400d2cc1 to 127.0.0.1:63267 2023-07-13 23:12:56,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:56,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x5ace14de to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:12:56,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@730c4062, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:12:56,154 DEBUG [hconnection-0x4aed4bc8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:56,158 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:12:56,173 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:12:56,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ace14de to 127.0.0.1:63267 2023-07-13 23:12:56,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:12:56,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 23:12:56,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:12:56,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:56,181 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:56,181 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689290576181 2023-07-13 23:12:56,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 23:12:56,185 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:12:56,185 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:12:56,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:56,187 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 23:12:56,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-13 23:12:56,189 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:56,189 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689290576189 2023-07-13 23:12:56,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,204 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 23:12:56,204 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:56,206 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-13 23:12:56,206 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-13 23:12:56,285 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:56,286 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,286 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:56,287 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:12:56,289 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,289 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,289 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,289 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,289 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:56,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:56,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 23:12:56,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,299 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:56,299 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:56,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,311 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:56,311 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:56,316 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:56,317 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:56,317 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:56,319 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,319 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,319 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:56,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,327 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 23:12:56,327 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 23:12:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 23:12:56,341 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,341 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:56,341 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,341 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:56,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:56,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-13 23:12:56,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14c7723c[Count = 0] remaining members to acquire global barrier 2023-07-13 23:12:56,345 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-13 23:12:56,345 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,346 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,355 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,355 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:12:56,356 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:12:56,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 23:12:56,358 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:56,358 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:56,358 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:56,363 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:12:56,363 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:12:56,363 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,363 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:12:56,367 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:56,367 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:56,367 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:56,397 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:12:56,397 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. started... 2023-07-13 23:12:56,399 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 715ad825d882603bb1c2c74526143efa: 2023-07-13 23:12:56,399 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,399 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:12:56,400 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/09679dc8e1b64e4a8423c0cdf4aeed8c.fa5e829568eb99b1b9d2d8f354259106->hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c-top, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/ae543494de87483399438c503ffe3161.5d4193cb47f9f692d22cd86cdb772487->hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161-top] hfiles 2023-07-13 23:12:56,400 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/09679dc8e1b64e4a8423c0cdf4aeed8c.fa5e829568eb99b1b9d2d8f354259106 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,407 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/ae543494de87483399438c503ffe3161.5d4193cb47f9f692d22cd86cdb772487 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,437 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. completed. 2023-07-13 23:12:56,437 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:12:56,437 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:12:56,437 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:12:56,437 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,437 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 23:12:56,437 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:12:56,444 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,444 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 23:12:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:56,444 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:56,444 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 23:12:56,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:56,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:56,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:12:56,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-13 23:12:56,448 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-13 23:12:56,448 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:12:56,448 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:12:56,448 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,448 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:12:56,450 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,451 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:12:56,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,452 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,454 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,454 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,455 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,457 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:12:56,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:12:56,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:12:56,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:12:56,458 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,459 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:12:56,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:12:56,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:12:56,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:12:56,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-13 23:12:56,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,487 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:56,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:56,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:56,488 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:12:56,789 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:12:56,791 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:12:56,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-13 23:12:56,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,920 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:56,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689289976181Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289976458 (+277 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289976458Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289976461 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689289976475 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689289976919 (+444 ms) 2023-07-13 23:12:56,923 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 23:12:56,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 738 msec 2023-07-13 23:12:56,925 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:12:57,291 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:12:57,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 23:12:57,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:12:57,292 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292 2023-07-13 23:12:57,293 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44557, tgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292, rawTgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:57,319 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:12:57,319 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1883854827_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:57,319 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-13 23:12:57,330 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:12:57,356 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:57,356 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:57,357 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:57,357 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,385 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-1853351686295752050.jar 2023-07-13 23:12:58,386 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,386 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,467 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-4820406207418559137.jar 2023-07-13 23:12:58,468 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,468 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,469 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,470 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,470 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,471 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:12:58,471 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:12:58,472 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:12:58,472 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:12:58,473 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:12:58,473 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:12:58,474 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:12:58,474 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:12:58,475 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:12:58,475 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:12:58,476 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:12:58,477 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:58,477 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:12:58,479 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:58,479 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:12:59,358 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:12:59,360 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-13 23:12:59,363 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-13 23:12:59,499 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:59,502 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:12:59,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:05,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:07,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:11,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:13,795 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:13,801 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:13,821 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,821 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:13,822 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:13,822 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,822 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 23:13:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 23:13:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 23:13:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289977292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 23:13:13,836 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:13,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289993842"}]},"ts":"1689289993842"} 2023-07-13 23:13:13,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:13,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-13 23:13:13,846 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-13 23:13:13,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, UNASSIGN}] 2023-07-13 23:13:13,850 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, UNASSIGN 2023-07-13 23:13:13,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=715ad825d882603bb1c2c74526143efa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:13,859 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289993859"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289993859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289993859"}]},"ts":"1689289993859"} 2023-07-13 23:13:13,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 715ad825d882603bb1c2c74526143efa, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:13:13,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:14,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 715ad825d882603bb1c2c74526143efa 2023-07-13 23:13:14,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 715ad825d882603bb1c2c74526143efa, disabling compactions & flushes 2023-07-13 23:13:14,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:13:14,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:13:14,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. after waiting 0 ms 2023-07-13 23:13:14,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:13:14,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-13 23:13:14,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:14,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa. 2023-07-13 23:13:14,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 715ad825d882603bb1c2c74526143efa: 2023-07-13 23:13:14,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 715ad825d882603bb1c2c74526143efa 2023-07-13 23:13:14,030 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=715ad825d882603bb1c2c74526143efa, regionState=CLOSED 2023-07-13 23:13:14,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689289994030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289994030"}]},"ts":"1689289994030"} 2023-07-13 23:13:14,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-13 23:13:14,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 715ad825d882603bb1c2c74526143efa, server=jenkins-hbase4.apache.org,45125,1689289892301 in 171 msec 2023-07-13 23:13:14,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-13 23:13:14,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=715ad825d882603bb1c2c74526143efa, UNASSIGN in 188 msec 2023-07-13 23:13:14,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289994037"}]},"ts":"1689289994037"} 2023-07-13 23:13:14,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-13 23:13:14,040 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-13 23:13:14,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 203 msec 2023-07-13 23:13:14,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 23:13:14,145 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-13 23:13:14,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,150 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,151 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,155 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,158 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa 2023-07-13 23:13:14,158 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:13:14,158 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:13:14,159 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,159 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,159 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,159 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:14,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:14,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:14,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,162 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,162 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/recovered.edits] 2023-07-13 23:13:14,163 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/recovered.edits] 2023-07-13 23:13:14,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 23:13:14,163 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/recovered.edits] 2023-07-13 23:13:14,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:14,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:14,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:14,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:14,169 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/09679dc8e1b64e4a8423c0cdf4aeed8c.fa5e829568eb99b1b9d2d8f354259106 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/09679dc8e1b64e4a8423c0cdf4aeed8c.fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:13:14,172 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/cf/ae543494de87483399438c503ffe3161 2023-07-13 23:13:14,173 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/cf/09679dc8e1b64e4a8423c0cdf4aeed8c 2023-07-13 23:13:14,174 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/ae543494de87483399438c503ffe3161.5d4193cb47f9f692d22cd86cdb772487 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/cf/ae543494de87483399438c503ffe3161.5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:13:14,177 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/recovered.edits/8.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487/recovered.edits/8.seqid 2023-07-13 23:13:14,177 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/recovered.edits/8.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106/recovered.edits/8.seqid 2023-07-13 23:13:14,178 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fa5e829568eb99b1b9d2d8f354259106 2023-07-13 23:13:14,178 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d4193cb47f9f692d22cd86cdb772487 2023-07-13 23:13:14,180 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/recovered.edits/12.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa/recovered.edits/12.seqid 2023-07-13 23:13:14,181 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/715ad825d882603bb1c2c74526143efa 2023-07-13 23:13:14,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 23:13:14,183 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,191 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-13 23:13:14,193 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-13 23:13:14,194 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,194 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-13 23:13:14,194 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289994194"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:14,196 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-13 23:13:14,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 715ad825d882603bb1c2c74526143efa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689289974368.715ad825d882603bb1c2c74526143efa.', STARTKEY => '', ENDKEY => ''}] 2023-07-13 23:13:14,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-13 23:13:14,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289994197"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:14,200 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-13 23:13:14,202 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 56 msec 2023-07-13 23:13:14,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 23:13:14,265 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-13 23:13:14,266 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:14,273 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289994273"}]},"ts":"1689289994273"} 2023-07-13 23:13:14,274 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-13 23:13:14,276 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-13 23:13:14,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, UNASSIGN}] 2023-07-13 23:13:14,279 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, UNASSIGN 2023-07-13 23:13:14,279 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, UNASSIGN 2023-07-13 23:13:14,280 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=feb0caf9d83c9f64098df10036a4f78c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:14,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c1c1605b57aab2d3aabff29fca450f89, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:14,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289994280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289994280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289994280"}]},"ts":"1689289994280"} 2023-07-13 23:13:14,280 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289994280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289994280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289994280"}]},"ts":"1689289994280"} 2023-07-13 23:13:14,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure feb0caf9d83c9f64098df10036a4f78c, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:13:14,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c1c1605b57aab2d3aabff29fca450f89, server=jenkins-hbase4.apache.org,41069,1689289892207}] 2023-07-13 23:13:14,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:14,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:13:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing feb0caf9d83c9f64098df10036a4f78c, disabling compactions & flushes 2023-07-13 23:13:14,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:13:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:13:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. after waiting 0 ms 2023-07-13 23:13:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:13:14,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:13:14,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1c1605b57aab2d3aabff29fca450f89, disabling compactions & flushes 2023-07-13 23:13:14,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:13:14,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:13:14,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. after waiting 0 ms 2023-07-13 23:13:14,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:13:14,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:14,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:14,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c. 2023-07-13 23:13:14,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for feb0caf9d83c9f64098df10036a4f78c: 2023-07-13 23:13:14,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:13:14,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=feb0caf9d83c9f64098df10036a4f78c, regionState=CLOSED 2023-07-13 23:13:14,463 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289994463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289994463"}]},"ts":"1689289994463"} 2023-07-13 23:13:14,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:14,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:14,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89. 2023-07-13 23:13:14,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1c1605b57aab2d3aabff29fca450f89: 2023-07-13 23:13:14,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:13:14,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c1c1605b57aab2d3aabff29fca450f89, regionState=CLOSED 2023-07-13 23:13:14,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689289994475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289994475"}]},"ts":"1689289994475"} 2023-07-13 23:13:14,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-13 23:13:14,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure feb0caf9d83c9f64098df10036a4f78c, server=jenkins-hbase4.apache.org,40551,1689289892359 in 183 msec 2023-07-13 23:13:14,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=feb0caf9d83c9f64098df10036a4f78c, UNASSIGN in 199 msec 2023-07-13 23:13:14,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-13 23:13:14,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c1c1605b57aab2d3aabff29fca450f89, server=jenkins-hbase4.apache.org,41069,1689289892207 in 195 msec 2023-07-13 23:13:14,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-13 23:13:14,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c1c1605b57aab2d3aabff29fca450f89, UNASSIGN in 203 msec 2023-07-13 23:13:14,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289994482"}]},"ts":"1689289994482"} 2023-07-13 23:13:14,483 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-13 23:13:14,486 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-13 23:13:14,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 220 msec 2023-07-13 23:13:14,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 23:13:14,576 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-13 23:13:14,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,584 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,586 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,586 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:14,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 23:13:14,589 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,589 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,589 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,590 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:14,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-13 23:13:14,591 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:13:14,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 23:13:14,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 23:13:14,595 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:13:14,595 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:13:14,597 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/recovered.edits] 2023-07-13 23:13:14,598 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/recovered.edits] 2023-07-13 23:13:14,602 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/cf/675d2070365a4e5ca5717363f43efca5 2023-07-13 23:13:14,608 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/cf/8d15f84275ea4a009096e901c28aaa99 2023-07-13 23:13:14,609 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c/recovered.edits/9.seqid 2023-07-13 23:13:14,610 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/feb0caf9d83c9f64098df10036a4f78c 2023-07-13 23:13:14,612 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89/recovered.edits/9.seqid 2023-07-13 23:13:14,613 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c1c1605b57aab2d3aabff29fca450f89 2023-07-13 23:13:14,613 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 23:13:14,616 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,618 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-13 23:13:14,626 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-13 23:13:14,635 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,635 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-13 23:13:14,635 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289994635"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:14,635 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689289994635"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:14,638 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:14,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => feb0caf9d83c9f64098df10036a4f78c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689289971518.feb0caf9d83c9f64098df10036a4f78c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c1c1605b57aab2d3aabff29fca450f89, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689289971518.c1c1605b57aab2d3aabff29fca450f89.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:14,638 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-13 23:13:14,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689289994638"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:14,640 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-13 23:13:14,644 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 67 msec 2023-07-13 23:13:14,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 23:13:14,693 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-13 23:13:14,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 23:13:14,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 23:13:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 23:13:14,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-13 23:13:14,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 23:13:14,746 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 749) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:42490 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:43655 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:50436 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:49456 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022814692_1 at /127.0.0.1:50410 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=561 (was 424) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 186), AvailableMemoryMB=2897 (was 3670) 2023-07-13 23:13:14,747 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-13 23:13:14,772 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=561, ProcessCount=186, AvailableMemoryMB=2894 2023-07-13 23:13:14,772 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-13 23:13:14,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:13:14,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:14,778 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:13:14,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-13 23:13:14,779 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:13:14,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:14,786 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:14,786 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:14,786 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab empty. 2023-07-13 23:13:14,786 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e empty. 2023-07-13 23:13:14,787 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:14,790 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:14,790 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 23:13:14,831 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 23:13:14,833 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4620a13ae2ee372b2cb329aef7d7a8ab, NAME => 'testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:13:14,834 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f1a7275ad33a4ca625f901744726679e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:13:14,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:14,925 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:14,925 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f1a7275ad33a4ca625f901744726679e, disabling compactions & flushes 2023-07-13 23:13:14,925 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:14,926 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:14,926 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. after waiting 0 ms 2023-07-13 23:13:14,926 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:14,926 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:14,926 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f1a7275ad33a4ca625f901744726679e: 2023-07-13 23:13:15,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4620a13ae2ee372b2cb329aef7d7a8ab, disabling compactions & flushes 2023-07-13 23:13:15,307 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. after waiting 0 ms 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,307 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,307 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4620a13ae2ee372b2cb329aef7d7a8ab: 2023-07-13 23:13:15,310 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:13:15,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289995311"}]},"ts":"1689289995311"} 2023-07-13 23:13:15,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689289995311"}]},"ts":"1689289995311"} 2023-07-13 23:13:15,317 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:13:15,318 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:13:15,318 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289995318"}]},"ts":"1689289995318"} 2023-07-13 23:13:15,320 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 23:13:15,323 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:13:15,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:13:15,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:13:15,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:13:15,324 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:13:15,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, ASSIGN}] 2023-07-13 23:13:15,328 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, ASSIGN 2023-07-13 23:13:15,328 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, ASSIGN 2023-07-13 23:13:15,331 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:13:15,337 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:13:15,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:15,481 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:13:15,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f1a7275ad33a4ca625f901744726679e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,484 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4620a13ae2ee372b2cb329aef7d7a8ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,484 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289995484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289995484"}]},"ts":"1689289995484"} 2023-07-13 23:13:15,484 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689289995484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689289995484"}]},"ts":"1689289995484"} 2023-07-13 23:13:15,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f1a7275ad33a4ca625f901744726679e, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:13:15,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 4620a13ae2ee372b2cb329aef7d7a8ab, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:13:15,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:15,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1a7275ad33a4ca625f901744726679e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:13:15,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. service=AccessControlService 2023-07-13 23:13:15,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:15,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4620a13ae2ee372b2cb329aef7d7a8ab, NAME => 'testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:13:15,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. service=AccessControlService 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,645 INFO [StoreOpener-f1a7275ad33a4ca625f901744726679e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,645 INFO [StoreOpener-4620a13ae2ee372b2cb329aef7d7a8ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,647 DEBUG [StoreOpener-f1a7275ad33a4ca625f901744726679e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf 2023-07-13 23:13:15,647 DEBUG [StoreOpener-f1a7275ad33a4ca625f901744726679e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf 2023-07-13 23:13:15,647 DEBUG [StoreOpener-4620a13ae2ee372b2cb329aef7d7a8ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf 2023-07-13 23:13:15,647 DEBUG [StoreOpener-4620a13ae2ee372b2cb329aef7d7a8ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf 2023-07-13 23:13:15,647 INFO [StoreOpener-f1a7275ad33a4ca625f901744726679e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1a7275ad33a4ca625f901744726679e columnFamilyName cf 2023-07-13 23:13:15,647 INFO [StoreOpener-4620a13ae2ee372b2cb329aef7d7a8ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4620a13ae2ee372b2cb329aef7d7a8ab columnFamilyName cf 2023-07-13 23:13:15,648 INFO [StoreOpener-f1a7275ad33a4ca625f901744726679e-1] regionserver.HStore(310): Store=f1a7275ad33a4ca625f901744726679e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:15,648 INFO [StoreOpener-4620a13ae2ee372b2cb329aef7d7a8ab-1] regionserver.HStore(310): Store=4620a13ae2ee372b2cb329aef7d7a8ab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:15,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:15,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:15,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:15,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:15,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4620a13ae2ee372b2cb329aef7d7a8ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75159222, jitterRate=0.11995968222618103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:15,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4620a13ae2ee372b2cb329aef7d7a8ab: 2023-07-13 23:13:15,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1a7275ad33a4ca625f901744726679e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70863161, jitterRate=0.055943384766578674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:15,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1a7275ad33a4ca625f901744726679e: 2023-07-13 23:13:15,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab., pid=94, masterSystemTime=1689289995640 2023-07-13 23:13:15,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e., pid=93, masterSystemTime=1689289995638 2023-07-13 23:13:15,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:15,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4620a13ae2ee372b2cb329aef7d7a8ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,659 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289995659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289995659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289995659"}]},"ts":"1689289995659"} 2023-07-13 23:13:15,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:15,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:15,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f1a7275ad33a4ca625f901744726679e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689289995660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689289995660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689289995660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689289995660"}]},"ts":"1689289995660"} 2023-07-13 23:13:15,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-13 23:13:15,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 4620a13ae2ee372b2cb329aef7d7a8ab, server=jenkins-hbase4.apache.org,40551,1689289892359 in 174 msec 2023-07-13 23:13:15,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-13 23:13:15,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f1a7275ad33a4ca625f901744726679e, server=jenkins-hbase4.apache.org,45125,1689289892301 in 175 msec 2023-07-13 23:13:15,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, ASSIGN in 338 msec 2023-07-13 23:13:15,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-13 23:13:15,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, ASSIGN in 339 msec 2023-07-13 23:13:15,666 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:13:15,666 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689289995666"}]},"ts":"1689289995666"} 2023-07-13 23:13:15,667 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 23:13:15,673 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:13:15,673 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-13 23:13:15,675 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:15,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:15,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:15,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:15,676 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:15,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:15,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:15,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:15,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:15,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 904 msec 2023-07-13 23:13:15,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 23:13:15,885 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-13 23:13:15,885 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-13 23:13:15,886 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:15,889 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-13 23:13:15,889 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:15,889 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-13 23:13:15,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:15,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289995892 (current time:1689289995892). 2023-07-13 23:13:15,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:15,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x56bc0a42 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:15,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ecab38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:15,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:15,909 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:15,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56bc0a42 to 127.0.0.1:63267 2023-07-13 23:13:15,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:15,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x5b2c0f97 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:15,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6df4e0aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:15,931 DEBUG [hconnection-0x60cc2347-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:15,933 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:15,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:15,938 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b2c0f97 to 127.0.0.1:63267 2023-07-13 23:13:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:15,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:15,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:15,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:15,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:15,943 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:15,945 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290595945 2023-07-13 23:13:15,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:15,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:15,946 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:15,947 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:15,948 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:15,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:15,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-13 23:13:15,956 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:15,957 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290595957 2023-07-13 23:13:15,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,978 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-13 23:13:15,978 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:15,979 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 23:13:15,979 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:13:15,980 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,980 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,985 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:15,985 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:15,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:15,985 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,986 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:15,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:15,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:15,991 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:15,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,991 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:15,993 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:15,993 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:15,993 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:15,993 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:15,994 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:15,994 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:15,994 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:15,995 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:15,996 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,996 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:15,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:15,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6ea20f[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:16,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6ea20f[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:16,003 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:13:16,003 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,005 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,005 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,005 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,005 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,005 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:16,006 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,006 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,006 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:13:16,006 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:16,007 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:16,007 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:16,007 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:16,007 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:16,007 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:16,007 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. started... 2023-07-13 23:13:16,007 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. started... 2023-07-13 23:13:16,008 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4620a13ae2ee372b2cb329aef7d7a8ab: 2023-07-13 23:13:16,009 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,009 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,009 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,009 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:16,009 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,010 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:16,010 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1a7275ad33a4ca625f901744726679e: 2023-07-13 23:13:16,011 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,011 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:16,011 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:16,035 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. completed. 2023-07-13 23:13:16,035 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,035 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:13:16,037 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,037 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,037 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. completed. 2023-07-13 23:13:16,037 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,037 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,037 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:13:16,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,040 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,040 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,040 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,050 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:16,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,052 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:13:16,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:13:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:13:16,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:13:16,057 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 23:13:16,058 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:16,058 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:16,058 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,058 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:16,059 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,059 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,059 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,062 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,063 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,065 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,066 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,066 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,069 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,070 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,070 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,072 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,072 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,072 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 23:13:16,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,125 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689289995945Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689289996070 (+125 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689289996072 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689289996076 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689289996092 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689289996125 (+33 ms) 2023-07-13 23:13:16,130 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:16,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 184 msec 2023-07-13 23:13:16,252 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:16,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:16,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:16,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:16,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45125] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:16,267 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:16,267 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:16,267 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:16,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:16,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689289996279 (current time:1689289996279). 2023-07-13 23:13:16,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:16,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x34eb62e5 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:16,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@353ca924, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:16,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:16,293 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:16,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34eb62e5 to 127.0.0.1:63267 2023-07-13 23:13:16,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:16,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x51cffa93 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:16,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5c5605, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:16,306 DEBUG [hconnection-0x6ef9bd63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:16,307 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:16,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:16,318 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51cffa93 to 127.0.0.1:63267 2023-07-13 23:13:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 23:13:16,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:16,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:16,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:16,323 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:16,324 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689290596324 2023-07-13 23:13:16,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 23:13:16,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:16,324 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:16,325 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:16,326 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 23:13:16,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:16,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-13 23:13:16,328 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:16,329 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689290596329 2023-07-13 23:13:16,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,345 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-13 23:13:16,345 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:16,347 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 23:13:16,347 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 23:13:16,347 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,347 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,348 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,348 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,348 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,348 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,349 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,349 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,350 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,350 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,350 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:16,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:16,352 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:16,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:16,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,353 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:16,353 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 23:13:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 23:13:16,354 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 23:13:16,354 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 23:13:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 23:13:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 23:13:16,358 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,358 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:16,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,361 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,361 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:16,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,362 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6184ad5e[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 23:13:16,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6184ad5e[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:16,366 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 23:13:16,366 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,370 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,371 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:13:16,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 23:13:16,371 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,371 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:16,371 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:16,371 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:16,371 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. started... 2023-07-13 23:13:16,371 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1a7275ad33a4ca625f901744726679e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-13 23:13:16,373 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,373 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,373 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:16,376 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:16,376 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. started... 2023-07-13 23:13:16,376 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4620a13ae2ee372b2cb329aef7d7a8ab 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-13 23:13:16,416 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/.tmp/cf/e84b6150a1ec4a3bb60d8cc62c32322b 2023-07-13 23:13:16,418 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/.tmp/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 2023-07-13 23:13:16,424 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/.tmp/cf/e84b6150a1ec4a3bb60d8cc62c32322b as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b 2023-07-13 23:13:16,425 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/.tmp/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 2023-07-13 23:13:16,426 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:16,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:16,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:16,428 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:16,430 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b, entries=3, sequenceid=6, filesize=5.0 K 2023-07-13 23:13:16,431 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4620a13ae2ee372b2cb329aef7d7a8ab in 55ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:16,431 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-13 23:13:16,431 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5, entries=47, sequenceid=6, filesize=8 K 2023-07-13 23:13:16,431 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4620a13ae2ee372b2cb329aef7d7a8ab: 2023-07-13 23:13:16,431 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:16,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b] hfiles 2023-07-13 23:13:16,432 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,432 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f1a7275ad33a4ca625f901744726679e in 61ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:16,434 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1a7275ad33a4ca625f901744726679e: 2023-07-13 23:13:16,434 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,434 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:16,434 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5] hfiles 2023-07-13 23:13:16,434 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,443 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. completed. 2023-07-13 23:13:16,443 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,455 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,455 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:13:16,457 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,457 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,458 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,458 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,460 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. completed. 2023-07-13 23:13:16,460 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:16,460 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:16,460 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:16,460 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,460 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 23:13:16,460 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:13:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,463 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,463 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 23:13:16,463 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,463 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 23:13:16,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:13:16,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 23:13:16,472 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 23:13:16,472 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:16,472 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:16,472 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,472 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:16,474 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,474 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,474 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,474 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,475 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,475 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:16,477 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,477 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:16,478 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:16,480 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,480 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,481 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,484 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:16,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:16,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:16,484 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,487 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:16,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:16,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:16,628 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:16,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:16,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:16,629 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:16,930 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:16,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:16,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:16,931 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:13:17,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 23:13:17,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:17,025 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:17,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689289996324Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689289996484 (+160 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689289996484Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689289996495 (+11 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689289996547 (+52 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689289997024 (+477 ms) 2023-07-13 23:13:17,029 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 23:13:17,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 704 msec 2023-07-13 23:13:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:17,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 23:13:17,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:17,433 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433 2023-07-13 23:13:17,433 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44557, tgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433, rawTgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:13:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:13:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-766986856_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:17,459 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-13 23:13:17,466 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:17,494 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:17,494 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:17,495 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:17,495 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0005_000001 (auth:SIMPLE) 2023-07-13 23:13:18,681 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-524526535819202059.jar 2023-07-13 23:13:18,682 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,682 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,765 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-4873293624451838184.jar 2023-07-13 23:13:18,766 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,766 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,767 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,768 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,768 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,768 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:18,769 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:13:18,769 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:13:18,770 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:13:18,770 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:13:18,770 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:13:18,771 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:13:18,771 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:13:18,772 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:13:18,772 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:13:18,773 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:13:18,773 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:18,774 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:18,774 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:18,775 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:18,775 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:18,776 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:18,776 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:19,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:13:20,215 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:13:20,219 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-13 23:13:20,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:20,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:21,089 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:27,185 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:29,701 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:29,702 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:29,713 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:29,713 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:29,714 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:29,714 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:29,715 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 23:13:29,715 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 23:13:29,715 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:29,715 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 23:13:29,716 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689289997433/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 23:13:29,725 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-13 23:13:29,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-13 23:13:29,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:29,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:29,736 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290009736"}]},"ts":"1689290009736"} 2023-07-13 23:13:29,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 23:13:29,740 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-13 23:13:29,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, UNASSIGN}] 2023-07-13 23:13:29,743 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, UNASSIGN 2023-07-13 23:13:29,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f1a7275ad33a4ca625f901744726679e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:29,751 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290009751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290009751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290009751"}]},"ts":"1689290009751"} 2023-07-13 23:13:29,752 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, UNASSIGN 2023-07-13 23:13:29,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4620a13ae2ee372b2cb329aef7d7a8ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:29,755 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290009754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290009754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290009754"}]},"ts":"1689290009754"} 2023-07-13 23:13:29,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f1a7275ad33a4ca625f901744726679e, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:13:29,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4620a13ae2ee372b2cb329aef7d7a8ab, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:13:29,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:29,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:29,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1a7275ad33a4ca625f901744726679e, disabling compactions & flushes 2023-07-13 23:13:29,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:29,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:29,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. after waiting 0 ms 2023-07-13 23:13:29,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:29,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:29,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4620a13ae2ee372b2cb329aef7d7a8ab, disabling compactions & flushes 2023-07-13 23:13:29,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:29,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:29,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. after waiting 0 ms 2023-07-13 23:13:29,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:29,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:29,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e. 2023-07-13 23:13:29,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1a7275ad33a4ca625f901744726679e: 2023-07-13 23:13:29,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:29,958 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f1a7275ad33a4ca625f901744726679e, regionState=CLOSED 2023-07-13 23:13:29,958 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290009958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290009958"}]},"ts":"1689290009958"} 2023-07-13 23:13:29,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-13 23:13:29,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f1a7275ad33a4ca625f901744726679e, server=jenkins-hbase4.apache.org,45125,1689289892301 in 207 msec 2023-07-13 23:13:29,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:29,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:29,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab. 2023-07-13 23:13:29,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4620a13ae2ee372b2cb329aef7d7a8ab: 2023-07-13 23:13:29,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1a7275ad33a4ca625f901744726679e, UNASSIGN in 222 msec 2023-07-13 23:13:29,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:29,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4620a13ae2ee372b2cb329aef7d7a8ab, regionState=CLOSED 2023-07-13 23:13:29,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689290009968"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290009968"}]},"ts":"1689290009968"} 2023-07-13 23:13:29,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-13 23:13:29,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4620a13ae2ee372b2cb329aef7d7a8ab, server=jenkins-hbase4.apache.org,40551,1689289892359 in 211 msec 2023-07-13 23:13:29,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-13 23:13:29,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4620a13ae2ee372b2cb329aef7d7a8ab, UNASSIGN in 229 msec 2023-07-13 23:13:29,977 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290009976"}]},"ts":"1689290009976"} 2023-07-13 23:13:29,978 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 23:13:29,980 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-13 23:13:29,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 254 msec 2023-07-13 23:13:30,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 23:13:30,039 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-13 23:13:30,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,042 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,043 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,044 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,048 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:30,048 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:30,048 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,048 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,048 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,048 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:30,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:30,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:30,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 23:13:30,050 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/recovered.edits] 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,050 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/recovered.edits] 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,050 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,051 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,051 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 23:13:30,058 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/cf/e84b6150a1ec4a3bb60d8cc62c32322b 2023-07-13 23:13:30,058 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/cf/f93f4bbf2a354e80a86a6a4c79f7aea5 2023-07-13 23:13:30,063 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab/recovered.edits/9.seqid 2023-07-13 23:13:30,063 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e/recovered.edits/9.seqid 2023-07-13 23:13:30,063 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/4620a13ae2ee372b2cb329aef7d7a8ab 2023-07-13 23:13:30,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1a7275ad33a4ca625f901744726679e 2023-07-13 23:13:30,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 23:13:30,066 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,068 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-13 23:13:30,070 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-13 23:13:30,071 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,071 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-13 23:13:30,071 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290010071"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:30,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290010071"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:30,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:30,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4620a13ae2ee372b2cb329aef7d7a8ab, NAME => 'testtb-testEmptyExportFileSystemState,,1689289994773.4620a13ae2ee372b2cb329aef7d7a8ab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f1a7275ad33a4ca625f901744726679e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689289994773.f1a7275ad33a4ca625f901744726679e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:30,073 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-13 23:13:30,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689290010073"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:30,075 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-13 23:13:30,076 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 23:13:30,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 37 msec 2023-07-13 23:13:30,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 23:13:30,153 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-13 23:13:30,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-13 23:13:30,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:30,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-13 23:13:30,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-13 23:13:30,199 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 761) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:35247 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:44009 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:33146 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4604 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2122301879_1 at /127.0.0.1:33130 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:52288 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:36443 from appattempt_1689289901420_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:41700 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=640 (was 561) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=3331 (was 2894) - AvailableMemoryMB LEAK? - 2023-07-13 23:13:30,199 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-13 23:13:30,226 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=640, ProcessCount=183, AvailableMemoryMB=3329 2023-07-13 23:13:30,227 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-13 23:13:30,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 23:13:30,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,232 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 23:13:30,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-13 23:13:30,233 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 23:13:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:30,236 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,236 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,236 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 empty. 2023-07-13 23:13:30,237 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 empty. 2023-07-13 23:13:30,237 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,237 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 23:13:30,262 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-13 23:13:30,267 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52c438845a889d4e7d93c3165a146c93, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:13:30,267 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 98415d00dfaebe8b272a9ff498aeb765, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp 2023-07-13 23:13:30,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:30,292 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 98415d00dfaebe8b272a9ff498aeb765, disabling compactions & flushes 2023-07-13 23:13:30,293 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. after waiting 0 ms 2023-07-13 23:13:30,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,293 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,293 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 98415d00dfaebe8b272a9ff498aeb765: 2023-07-13 23:13:30,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:30,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 52c438845a889d4e7d93c3165a146c93, disabling compactions & flushes 2023-07-13 23:13:30,294 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,294 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,295 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. after waiting 0 ms 2023-07-13 23:13:30,295 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,295 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,295 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 52c438845a889d4e7d93c3165a146c93: 2023-07-13 23:13:30,297 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 23:13:30,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290010298"}]},"ts":"1689290010298"} 2023-07-13 23:13:30,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290010298"}]},"ts":"1689290010298"} 2023-07-13 23:13:30,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 23:13:30,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 23:13:30,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290010301"}]},"ts":"1689290010301"} 2023-07-13 23:13:30,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-13 23:13:30,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-13 23:13:30,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 23:13:30,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 23:13:30,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 23:13:30,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 23:13:30,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, ASSIGN}] 2023-07-13 23:13:30,311 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, ASSIGN 2023-07-13 23:13:30,311 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, ASSIGN 2023-07-13 23:13:30,312 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40551,1689289892359; forceNewPlan=false, retain=false 2023-07-13 23:13:30,312 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45125,1689289892301; forceNewPlan=false, retain=false 2023-07-13 23:13:30,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:30,462 INFO [jenkins-hbase4:39197] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 23:13:30,465 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=98415d00dfaebe8b272a9ff498aeb765, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=52c438845a889d4e7d93c3165a146c93, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,465 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290010465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290010465"}]},"ts":"1689290010465"} 2023-07-13 23:13:30,465 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290010465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290010465"}]},"ts":"1689290010465"} 2023-07-13 23:13:30,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 98415d00dfaebe8b272a9ff498aeb765, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:13:30,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 52c438845a889d4e7d93c3165a146c93, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:13:30,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:30,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98415d00dfaebe8b272a9ff498aeb765, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 23:13:30,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. service=AccessControlService 2023-07-13 23:13:30,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:30,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:30,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52c438845a889d4e7d93c3165a146c93, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 23:13:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. service=AccessControlService 2023-07-13 23:13:30,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 23:13:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 23:13:30,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,640 INFO [StoreOpener-98415d00dfaebe8b272a9ff498aeb765-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,645 DEBUG [StoreOpener-98415d00dfaebe8b272a9ff498aeb765-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf 2023-07-13 23:13:30,645 DEBUG [StoreOpener-98415d00dfaebe8b272a9ff498aeb765-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf 2023-07-13 23:13:30,645 INFO [StoreOpener-98415d00dfaebe8b272a9ff498aeb765-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98415d00dfaebe8b272a9ff498aeb765 columnFamilyName cf 2023-07-13 23:13:30,646 INFO [StoreOpener-98415d00dfaebe8b272a9ff498aeb765-1] regionserver.HStore(310): Store=98415d00dfaebe8b272a9ff498aeb765/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:30,651 INFO [StoreOpener-52c438845a889d4e7d93c3165a146c93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,655 DEBUG [StoreOpener-52c438845a889d4e7d93c3165a146c93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf 2023-07-13 23:13:30,655 DEBUG [StoreOpener-52c438845a889d4e7d93c3165a146c93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf 2023-07-13 23:13:30,656 INFO [StoreOpener-52c438845a889d4e7d93c3165a146c93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52c438845a889d4e7d93c3165a146c93 columnFamilyName cf 2023-07-13 23:13:30,657 INFO [StoreOpener-52c438845a889d4e7d93c3165a146c93-1] regionserver.HStore(310): Store=52c438845a889d4e7d93c3165a146c93/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 23:13:30,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:30,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:30,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52c438845a889d4e7d93c3165a146c93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64118972, jitterRate=-0.04455286264419556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:30,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52c438845a889d4e7d93c3165a146c93: 2023-07-13 23:13:30,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 23:13:30,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93., pid=109, masterSystemTime=1689290010625 2023-07-13 23:13:30,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98415d00dfaebe8b272a9ff498aeb765; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71567488, jitterRate=0.06643867492675781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 23:13:30,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98415d00dfaebe8b272a9ff498aeb765: 2023-07-13 23:13:30,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765., pid=108, masterSystemTime=1689290010622 2023-07-13 23:13:30,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=98415d00dfaebe8b272a9ff498aeb765, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=52c438845a889d4e7d93c3165a146c93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689290010676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689290010676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689290010676"}]},"ts":"1689290010676"} 2023-07-13 23:13:30,677 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290010676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689290010676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689290010676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689290010676"}]},"ts":"1689290010676"} 2023-07-13 23:13:30,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-13 23:13:30,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 52c438845a889d4e7d93c3165a146c93, server=jenkins-hbase4.apache.org,40551,1689289892359 in 212 msec 2023-07-13 23:13:30,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-13 23:13:30,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 98415d00dfaebe8b272a9ff498aeb765, server=jenkins-hbase4.apache.org,45125,1689289892301 in 215 msec 2023-07-13 23:13:30,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, ASSIGN in 379 msec 2023-07-13 23:13:30,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-13 23:13:30,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, ASSIGN in 382 msec 2023-07-13 23:13:30,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 23:13:30,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290010693"}]},"ts":"1689290010693"} 2023-07-13 23:13:30,695 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-13 23:13:30,698 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 23:13:30,698 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-13 23:13:30,700 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:30,702 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,702 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,702 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,702 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:30,708 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,708 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,708 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,708 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:30,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:30,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:30,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 23:13:30,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 480 msec 2023-07-13 23:13:30,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 23:13:30,838 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-13 23:13:30,838 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-13 23:13:30,838 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:30,842 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-13 23:13:30,842 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:30,842 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-13 23:13:30,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:30,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689290010845 (current time:1689290010845). 2023-07-13 23:13:30,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:30,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x5a197846 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:30,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@608310ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:30,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:30,866 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:30,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a197846 to 127.0.0.1:63267 2023-07-13 23:13:30,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:30,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x56b75d6b to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:30,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47fdd4b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:30,879 DEBUG [hconnection-0x3f81a8d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:30,882 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:30,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:30,890 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:30,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56b75d6b to 127.0.0.1:63267 2023-07-13 23:13:30,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:30,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:30,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:30,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:30,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:30,896 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:30,897 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689290610897 2023-07-13 23:13:30,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:30,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,898 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:30,898 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:30,899 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:30,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:30,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-13 23:13:30,901 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:30,902 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689290610902 2023-07-13 23:13:30,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,919 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:30,919 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:30,921 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 23:13:30,921 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 23:13:30,922 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,922 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,924 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:30,924 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:30,924 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:30,924 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:30,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:30,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,926 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,926 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,927 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,927 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:30,927 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:30,936 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:30,936 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:30,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:30,936 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:30,936 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:30,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:30,938 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:30,939 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:30,948 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,949 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:30,950 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a407281[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:30,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:30,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:30,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a407281[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:30,957 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 23:13:30,957 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,959 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,959 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,960 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:30,960 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:30,960 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:30,960 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:30,960 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,960 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,960 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. started... 2023-07-13 23:13:30,960 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,960 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:30,962 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98415d00dfaebe8b272a9ff498aeb765: 2023-07-13 23:13:30,962 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,962 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:30,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,962 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,962 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:30,963 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,962 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,963 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:30,963 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:30,963 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:30,963 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. started... 2023-07-13 23:13:30,963 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:13:30,965 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52c438845a889d4e7d93c3165a146c93: 2023-07-13 23:13:30,965 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:30,965 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:30,965 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 23:13:30,978 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:30,978 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:30,978 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:30,997 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. completed. 2023-07-13 23:13:30,997 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:13:30,998 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. completed. 2023-07-13 23:13:30,998 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:30,998 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:30,998 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:30,999 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:13:30,999 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:30,999 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:30,999 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:31,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:31,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:31,002 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:31,002 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:31,002 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:31,002 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:31,007 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:13:31,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 23:13:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:31,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:13:31,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 23:13:31,017 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 23:13:31,017 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:31,017 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:31,017 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,017 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,021 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,021 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:31,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,023 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,023 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:31,025 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,026 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,027 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,029 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:31,030 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:31,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:31,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,032 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,030 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:31,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:31,031 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:31,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:31,032 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:31,032 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,032 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:31,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,202 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:31,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:31,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:31,204 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:31,504 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:31,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:31,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:31,505 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 23:13:31,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 23:13:31,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,576 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:31,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689290010897Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290011032 (+135 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290011032Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290011041 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689290011060 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689290011575 (+515 ms) 2023-07-13 23:13:31,579 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:31,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 681 msec 2023-07-13 23:13:32,005 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:32,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:32,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:32,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40551] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:32,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45125] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 23:13:32,032 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,033 DEBUG [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:32,033 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 23:13:32,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689290012076 (current time:1689290012076). 2023-07-13 23:13:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 23:13:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x783cba10 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:32,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ac94aef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:32,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:32,099 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:32,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x783cba10 to 127.0.0.1:63267 2023-07-13 23:13:32,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:32,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(139): Connect 0x24e140b7 to 127.0.0.1:63267 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 23:13:32,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39109201, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 23:13:32,139 DEBUG [hconnection-0x390e39fe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:32,142 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:32,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 23:13:32,147 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 23:13:32,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24e140b7 to 127.0.0.1:63267 2023-07-13 23:13:32,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:13:32,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 23:13:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 23:13:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:32,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:32,155 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:32,156 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689290612156 2023-07-13 23:13:32,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 23:13:32,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,158 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 23:13:32,158 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 23:13:32,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:32,160 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 23:13:32,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-13 23:13:32,163 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:32,164 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689290612163 2023-07-13 23:13:32,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,191 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:32,191 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:32,193 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 23:13:32,193 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 23:13:32,253 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,253 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,254 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,254 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,254 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,254 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,255 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,255 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,255 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,255 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:32,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 23:13:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 23:13:32,257 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:32,257 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:32,258 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:32,258 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:32,258 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689289892207' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:32,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,259 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:32,259 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:32,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,259 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:32,259 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 23:13:32,259 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 23:13:32,261 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:32,261 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:32,261 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 23:13:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 23:13:32,262 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 23:13:32,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:32,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:32,262 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 23:13:32,264 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,265 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,265 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:32,265 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,266 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:32,266 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,266 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 23:13:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45125,1689289892301' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b9bf67[Count = 1] remaining members to acquire global barrier 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:32,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40551,1689289892359' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 23:13:32,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b9bf67[Count = 0] remaining members to acquire global barrier 2023-07-13 23:13:32,270 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 23:13:32,270 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,274 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,274 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:32,274 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41069,1689289892207' in zk 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 23:13:32,275 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:32,275 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,275 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 23:13:32,275 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:32,275 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. started... 2023-07-13 23:13:32,275 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. started... 2023-07-13 23:13:32,275 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 23:13:32,275 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 98415d00dfaebe8b272a9ff498aeb765 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-13 23:13:32,275 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 52c438845a889d4e7d93c3165a146c93 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-13 23:13:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689289892207' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:32,299 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/.tmp/cf/663351797a5a4540a669cc67ddb1b9a6 2023-07-13 23:13:32,305 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/.tmp/cf/663351797a5a4540a669cc67ddb1b9a6 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6 2023-07-13 23:13:32,312 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6, entries=5, sequenceid=6, filesize=5.2 K 2023-07-13 23:13:32,313 INFO [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 52c438845a889d4e7d93c3165a146c93 in 38ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:32,313 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-13 23:13:32,313 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52c438845a889d4e7d93c3165a146c93: 2023-07-13 23:13:32,314 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,314 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:32,314 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6] hfiles 2023-07-13 23:13:32,314 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,319 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/.tmp/cf/58bef0cec13a4be78af9221d3026e929 2023-07-13 23:13:32,327 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/.tmp/cf/58bef0cec13a4be78af9221d3026e929 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929 2023-07-13 23:13:32,338 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929, entries=45, sequenceid=6, filesize=7.9 K 2023-07-13 23:13:32,341 INFO [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 98415d00dfaebe8b272a9ff498aeb765 in 66ms, sequenceid=6, compaction requested=false 2023-07-13 23:13:32,344 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98415d00dfaebe8b272a9ff498aeb765: 2023-07-13 23:13:32,345 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,345 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 23:13:32,345 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929] hfiles 2023-07-13 23:13:32,345 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,375 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. completed. 2023-07-13 23:13:32,375 DEBUG [rs(jenkins-hbase4.apache.org,40551,1689289892359)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:32,375 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:32,375 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:32,375 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,375 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:32,375 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40551,1689289892359' in zk 2023-07-13 23:13:32,377 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:32,377 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,377 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:32,377 DEBUG [member: 'jenkins-hbase4.apache.org,40551,1689289892359' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:32,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:32,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:32,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,383 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. completed. 2023-07-13 23:13:32,383 DEBUG [rs(jenkins-hbase4.apache.org,45125,1689289892301)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 23:13:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 23:13:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 23:13:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45125,1689289892301' in zk 2023-07-13 23:13:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40551,1689289892359': 2023-07-13 23:13:32,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40551,1689289892359' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 23:13:32,385 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:32,385 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 23:13:32,385 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:32,385 DEBUG [member: 'jenkins-hbase4.apache.org,45125,1689289892301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 23:13:32,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:32,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:32,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45125,1689289892301': 2023-07-13 23:13:32,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45125,1689289892301' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 23:13:32,391 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 23:13:32,391 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 23:13:32,391 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 23:13:32,391 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,391 INFO [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 23:13:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 23:13:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 23:13:32,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,395 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,396 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 23:13:32,397 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 23:13:32,400 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,400 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,401 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,404 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,404 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 23:13:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,406 DEBUG [(jenkins-hbase4.apache.org,39197,1689289890670)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 23:13:32,405 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 23:13:32,406 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 23:13:32,408 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,408 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:13:32,408 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:32,408 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,408 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 23:13:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 23:13:32,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,462 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:32,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:32,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 23:13:32,464 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 23:13:32,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 23:13:32,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,497 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689290012156Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689290012406 (+250 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689290012406Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689290012416 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689290012433 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689290012497 (+64 ms) 2023-07-13 23:13:32,501 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 23:13:32,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 343 msec 2023-07-13 23:13:32,764 DEBUG [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 23:13:32,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 23:13:32,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 23:13:32,766 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766 2023-07-13 23:13:32,766 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44557, tgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766, rawTgtDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766, srcFsUri=hdfs://localhost:44557, srcDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:13:32,793 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d 2023-07-13 23:13:32,793 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1982978357_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,793 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44557, inputRoot=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d, snapshotDir=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-13 23:13:32,811 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:32,887 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:32,887 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:32,888 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:32,888 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,011 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-450551971544231842.jar 2023-07-13 23:13:34,011 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,012 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,095 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/hadoop-4665776591561218606.jar 2023-07-13 23:13:34,095 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,096 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,096 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,097 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,097 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,098 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 23:13:34,098 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 23:13:34,098 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 23:13:34,099 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 23:13:34,099 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 23:13:34,100 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 23:13:34,100 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 23:13:34,101 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 23:13:34,101 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 23:13:34,102 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 23:13:34,102 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 23:13:34,103 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:34,103 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:34,104 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:34,104 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:34,105 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 23:13:34,106 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:34,106 DEBUG [Listener at jenkins-hbase4.apache.org/41829] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 23:13:34,874 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0006_000001 (auth:SIMPLE) 2023-07-13 23:13:35,306 WARN [Listener at jenkins-hbase4.apache.org/41829] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 23:13:35,309 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-13 23:13:35,311 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-13 23:13:35,419 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:35,420 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 23:13:35,572 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:13:35,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:41,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:43,413 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:48,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:49,580 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 23:13:49,580 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 23:13:49,591 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,591 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 23:13:49,591 INFO [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 23:13:49,591 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,592 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 23:13:49,592 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 23:13:49,592 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1445108501_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,593 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 23:13:49,593 DEBUG [Listener at jenkins-hbase4.apache.org/41829] snapshot.TestExportSnapshot(367): hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/export-test/export-1689290012766/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 23:13:49,598 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:49,602 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290029602"}]},"ts":"1689290029602"} 2023-07-13 23:13:49,604 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-13 23:13:49,605 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-13 23:13:49,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, UNASSIGN}] 2023-07-13 23:13:49,608 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, UNASSIGN 2023-07-13 23:13:49,608 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, UNASSIGN 2023-07-13 23:13:49,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=52c438845a889d4e7d93c3165a146c93, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:13:49,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290029608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290029608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290029608"}]},"ts":"1689290029608"} 2023-07-13 23:13:49,609 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=98415d00dfaebe8b272a9ff498aeb765, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:13:49,609 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290029609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689290029609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689290029609"}]},"ts":"1689290029609"} 2023-07-13 23:13:49,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 52c438845a889d4e7d93c3165a146c93, server=jenkins-hbase4.apache.org,40551,1689289892359}] 2023-07-13 23:13:49,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 98415d00dfaebe8b272a9ff498aeb765, server=jenkins-hbase4.apache.org,45125,1689289892301}] 2023-07-13 23:13:49,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:49,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:49,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52c438845a889d4e7d93c3165a146c93, disabling compactions & flushes 2023-07-13 23:13:49,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:49,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:49,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. after waiting 0 ms 2023-07-13 23:13:49,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:49,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98415d00dfaebe8b272a9ff498aeb765, disabling compactions & flushes 2023-07-13 23:13:49,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. after waiting 0 ms 2023-07-13 23:13:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:49,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:49,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:49,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765. 2023-07-13 23:13:49,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:13:49,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98415d00dfaebe8b272a9ff498aeb765: 2023-07-13 23:13:49,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:13:49,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93. 2023-07-13 23:13:49,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52c438845a889d4e7d93c3165a146c93: 2023-07-13 23:13:49,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:49,840 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=98415d00dfaebe8b272a9ff498aeb765, regionState=CLOSED 2023-07-13 23:13:49,840 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290029840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290029840"}]},"ts":"1689290029840"} 2023-07-13 23:13:49,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:49,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=52c438845a889d4e7d93c3165a146c93, regionState=CLOSED 2023-07-13 23:13:49,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689290029841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689290029841"}]},"ts":"1689290029841"} 2023-07-13 23:13:49,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-13 23:13:49,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 98415d00dfaebe8b272a9ff498aeb765, server=jenkins-hbase4.apache.org,45125,1689289892301 in 232 msec 2023-07-13 23:13:49,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-13 23:13:49,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 52c438845a889d4e7d93c3165a146c93, server=jenkins-hbase4.apache.org,40551,1689289892359 in 234 msec 2023-07-13 23:13:49,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98415d00dfaebe8b272a9ff498aeb765, UNASSIGN in 239 msec 2023-07-13 23:13:49,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-13 23:13:49,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=52c438845a889d4e7d93c3165a146c93, UNASSIGN in 240 msec 2023-07-13 23:13:49,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689290029852"}]},"ts":"1689290029852"} 2023-07-13 23:13:49,855 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-13 23:13:49,857 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-13 23:13:49,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 259 msec 2023-07-13 23:13:49,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 23:13:49,906 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-13 23:13:49,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,913 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,914 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40551] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,918 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,918 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,918 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,919 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:49,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:49,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:49,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:49,921 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:49,920 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 23:13:49,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 23:13:49,934 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:49,949 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:49,951 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/recovered.edits] 2023-07-13 23:13:49,953 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf, FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/recovered.edits] 2023-07-13 23:13:49,959 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/cf/663351797a5a4540a669cc67ddb1b9a6 2023-07-13 23:13:49,962 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929 to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/cf/58bef0cec13a4be78af9221d3026e929 2023-07-13 23:13:49,968 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93/recovered.edits/9.seqid 2023-07-13 23:13:49,969 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/52c438845a889d4e7d93c3165a146c93 2023-07-13 23:13:49,974 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/recovered.edits/9.seqid to hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765/recovered.edits/9.seqid 2023-07-13 23:13:49,975 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98415d00dfaebe8b272a9ff498aeb765 2023-07-13 23:13:49,976 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 23:13:49,979 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:49,985 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-13 23:13:50,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-13 23:13:50,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:50,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-13 23:13:50,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290030010"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:50,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689290030010"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:50,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 23:13:50,024 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 23:13:50,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 52c438845a889d4e7d93c3165a146c93, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689290010228.52c438845a889d4e7d93c3165a146c93.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 98415d00dfaebe8b272a9ff498aeb765, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689290010228.98415d00dfaebe8b272a9ff498aeb765.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 23:13:50,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-13 23:13:50,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689290030024"}]},"ts":"9223372036854775807"} 2023-07-13 23:13:50,031 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-13 23:13:50,034 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:50,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 126 msec 2023-07-13 23:13:50,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 23:13:50,226 INFO [Listener at jenkins-hbase4.apache.org/41829] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-13 23:13:50,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 23:13:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:50,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 23:13:50,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39197] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 23:13:50,291 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_550542846_1 at /127.0.0.1:57014 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:36932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:40719 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:57036 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1774328632) connection to jenkins-hbase4.apache.org/172.31.14.131:41829 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_550542846_1 at /127.0.0.1:57256 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x31c1ae37-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5211 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1445108501_17 at /127.0.0.1:57280 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=598 (was 640), ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=1873 (was 3329) 2023-07-13 23:13:50,291 WARN [Listener at jenkins-hbase4.apache.org/41829] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-13 23:13:50,291 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-13 23:13:50,336 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:13:54,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689289901420_0007_000001 (auth:SIMPLE) 2023-07-13 23:13:55,400 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 23:14:04,471 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:18,590 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:18,591 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:18,702 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-13 23:14:18,712 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-13 23:14:18,713 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:18,729 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-13 23:14:18,833 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 23:14:18,833 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-13 23:14:18,833 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-13 23:14:18,833 INFO [Listener at jenkins-hbase4.apache.org/41829] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-13 23:14:18,833 DEBUG [Listener at jenkins-hbase4.apache.org/41829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a17b1de to 127.0.0.1:63267 2023-07-13 23:14:18,833 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:18,833 DEBUG [Listener at jenkins-hbase4.apache.org/41829] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-13 23:14:18,833 DEBUG [Listener at jenkins-hbase4.apache.org/41829] util.JVMClusterUtil(257): Found active master hash=600077586, stopped=false 2023-07-13 23:14:18,834 DEBUG [Listener at jenkins-hbase4.apache.org/41829] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,834 DEBUG [Listener at jenkins-hbase4.apache.org/41829] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 23:14:18,834 INFO [Listener at jenkins-hbase4.apache.org/41829] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:14:18,835 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:18,835 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:18,835 INFO [Listener at jenkins-hbase4.apache.org/41829] procedure2.ProcedureExecutor(629): Stopping 2023-07-13 23:14:18,835 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:14:18,835 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:18,835 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 23:14:18,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:18,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:18,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:18,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 23:14:18,836 DEBUG [Listener at jenkins-hbase4.apache.org/41829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a466276 to 127.0.0.1:63267 2023-07-13 23:14:18,836 DEBUG [Listener at jenkins-hbase4.apache.org/41829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:18,836 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41069,1689289892207' ***** 2023-07-13 23:14:18,837 DEBUG [Listener at jenkins-hbase4.apache.org/41829] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,837 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:18,837 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45125,1689289892301' ***** 2023-07-13 23:14:18,837 DEBUG [Listener at jenkins-hbase4.apache.org/41829] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,837 INFO [RS:0;jenkins-hbase4:41069] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:18,837 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:18,837 INFO [RS:0;jenkins-hbase4:41069] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:18,837 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40551,1689289892359' ***** 2023-07-13 23:14:18,837 INFO [RS:0;jenkins-hbase4:41069] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:18,837 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:18,837 DEBUG [Listener at jenkins-hbase4.apache.org/41829] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,838 INFO [Listener at jenkins-hbase4.apache.org/41829] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 23:14:18,838 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:14:18,838 INFO [RS:1;jenkins-hbase4:45125] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:18,838 INFO [RS:1;jenkins-hbase4:45125] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:18,838 INFO [RS:1;jenkins-hbase4:45125] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:18,838 INFO [RS:2;jenkins-hbase4:40551] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 23:14:18,838 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:18,838 INFO [RS:2;jenkins-hbase4:40551] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 23:14:18,838 INFO [RS:2;jenkins-hbase4:40551] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 23:14:18,838 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:14:18,838 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:14:18,839 DEBUG [RS:1;jenkins-hbase4:45125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5366c819 to 127.0.0.1:63267 2023-07-13 23:14:18,839 DEBUG [RS:1;jenkins-hbase4:45125] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:18,839 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x774278ee to 127.0.0.1:63267 2023-07-13 23:14:18,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7034d5b2c08dbe7b30da55189a3347ba, disabling compactions & flushes 2023-07-13 23:14:18,838 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 23:14:18,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:14:18,842 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:18,841 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(3305): Received CLOSE for 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:14:18,843 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:18,843 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:14:18,842 INFO [RS:1;jenkins-hbase4:45125] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:18,843 DEBUG [RS:2;jenkins-hbase4:40551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dd64846 to 127.0.0.1:63267 2023-07-13 23:14:18,843 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1478): Online Regions={7034d5b2c08dbe7b30da55189a3347ba=hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba.} 2023-07-13 23:14:18,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:14:18,843 DEBUG [RS:2;jenkins-hbase4:40551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:18,843 INFO [RS:1;jenkins-hbase4:45125] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:18,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fcaaf78226c27a5b54c3c7a865cd50a, disabling compactions & flushes 2023-07-13 23:14:18,844 INFO [RS:1;jenkins-hbase4:45125] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:18,844 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:18,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. after waiting 0 ms 2023-07-13 23:14:18,844 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1478): Online Regions={2fcaaf78226c27a5b54c3c7a865cd50a=hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a.} 2023-07-13 23:14:18,844 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-13 23:14:18,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:14:18,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:14:18,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:14:18,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. after waiting 0 ms 2023-07-13 23:14:18,845 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 23:14:18,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7034d5b2c08dbe7b30da55189a3347ba 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-13 23:14:18,845 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-13 23:14:18,845 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 7034d5b2c08dbe7b30da55189a3347ba 2023-07-13 23:14:18,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 23:14:18,845 DEBUG [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1504): Waiting on 2fcaaf78226c27a5b54c3c7a865cd50a 2023-07-13 23:14:18,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:14:18,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 23:14:18,845 DEBUG [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-13 23:14:18,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2fcaaf78226c27a5b54c3c7a865cd50a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-13 23:14:18,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 23:14:18,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 23:14:18,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 23:14:18,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-13 23:14:18,873 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:18,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/.tmp/l/1feca21086344379b151f7600d765652 2023-07-13 23:14:18,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/info/928b4dec9a984b8ba5c643b5a5347e7d 2023-07-13 23:14:18,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/.tmp/info/08c0f361e09f4ab89b5517dc1c174b34 2023-07-13 23:14:18,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1feca21086344379b151f7600d765652 2023-07-13 23:14:18,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 928b4dec9a984b8ba5c643b5a5347e7d 2023-07-13 23:14:18,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/.tmp/l/1feca21086344379b151f7600d765652 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/l/1feca21086344379b151f7600d765652 2023-07-13 23:14:18,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/.tmp/info/08c0f361e09f4ab89b5517dc1c174b34 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/info/08c0f361e09f4ab89b5517dc1c174b34 2023-07-13 23:14:18,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1feca21086344379b151f7600d765652 2023-07-13 23:14:18,888 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:18,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/l/1feca21086344379b151f7600d765652, entries=7, sequenceid=18, filesize=5.2 K 2023-07-13 23:14:18,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/info/08c0f361e09f4ab89b5517dc1c174b34, entries=2, sequenceid=6, filesize=4.8 K 2023-07-13 23:14:18,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2fcaaf78226c27a5b54c3c7a865cd50a in 44ms, sequenceid=18, compaction requested=false 2023-07-13 23:14:18,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7034d5b2c08dbe7b30da55189a3347ba in 44ms, sequenceid=6, compaction requested=false 2023-07-13 23:14:18,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/rep_barrier/c78e602106d24e568575916f65e0890a 2023-07-13 23:14:18,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/namespace/7034d5b2c08dbe7b30da55189a3347ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 23:14:18,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/acl/2fcaaf78226c27a5b54c3c7a865cd50a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-13 23:14:18,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:14:18,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7034d5b2c08dbe7b30da55189a3347ba: 2023-07-13 23:14:18,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689289895210.7034d5b2c08dbe7b30da55189a3347ba. 2023-07-13 23:14:18,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:14:18,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fcaaf78226c27a5b54c3c7a865cd50a: 2023-07-13 23:14:18,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689289895963.2fcaaf78226c27a5b54c3c7a865cd50a. 2023-07-13 23:14:18,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c78e602106d24e568575916f65e0890a 2023-07-13 23:14:18,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/table/60cab4de3d3a4bd194abfa7c3b3ac7fc 2023-07-13 23:14:18,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60cab4de3d3a4bd194abfa7c3b3ac7fc 2023-07-13 23:14:18,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/info/928b4dec9a984b8ba5c643b5a5347e7d as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/info/928b4dec9a984b8ba5c643b5a5347e7d 2023-07-13 23:14:18,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 928b4dec9a984b8ba5c643b5a5347e7d 2023-07-13 23:14:18,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/info/928b4dec9a984b8ba5c643b5a5347e7d, entries=48, sequenceid=131, filesize=10.3 K 2023-07-13 23:14:18,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/rep_barrier/c78e602106d24e568575916f65e0890a as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/rep_barrier/c78e602106d24e568575916f65e0890a 2023-07-13 23:14:18,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c78e602106d24e568575916f65e0890a 2023-07-13 23:14:18,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/rep_barrier/c78e602106d24e568575916f65e0890a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-13 23:14:18,929 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/.tmp/table/60cab4de3d3a4bd194abfa7c3b3ac7fc as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/table/60cab4de3d3a4bd194abfa7c3b3ac7fc 2023-07-13 23:14:18,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60cab4de3d3a4bd194abfa7c3b3ac7fc 2023-07-13 23:14:18,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/table/60cab4de3d3a4bd194abfa7c3b3ac7fc, entries=24, sequenceid=131, filesize=6.9 K 2023-07-13 23:14:18,933 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:18,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=131, compaction requested=false 2023-07-13 23:14:18,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-13 23:14:18,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 23:14:18,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 23:14:18,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 23:14:18,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 23:14:18,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-13 23:14:19,045 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41069,1689289892207; all regions closed. 2023-07-13 23:14:19,045 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40551,1689289892359; all regions closed. 2023-07-13 23:14:19,046 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45125,1689289892301; all regions closed. 2023-07-13 23:14:19,061 DEBUG [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs 2023-07-13 23:14:19,061 INFO [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45125%2C1689289892301.meta:.meta(num 1689289894837) 2023-07-13 23:14:19,061 DEBUG [RS:2;jenkins-hbase4:40551] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs 2023-07-13 23:14:19,061 INFO [RS:2;jenkins-hbase4:40551] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40551%2C1689289892359:(num 1689289894656) 2023-07-13 23:14:19,061 DEBUG [RS:2;jenkins-hbase4:40551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:19,061 INFO [RS:2;jenkins-hbase4:40551] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:19,062 INFO [RS:2;jenkins-hbase4:40551] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:19,062 DEBUG [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs 2023-07-13 23:14:19,062 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41069%2C1689289892207:(num 1689289894656) 2023-07-13 23:14:19,062 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:19,062 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:19,062 INFO [RS:2;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:19,063 INFO [RS:2;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:19,063 INFO [RS:2;jenkins-hbase4:40551] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:19,062 INFO [RS:0;jenkins-hbase4:41069] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:19,065 INFO [RS:2;jenkins-hbase4:40551] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40551 2023-07-13 23:14:19,065 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:19,065 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 23:14:19,065 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:19,066 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 23:14:19,066 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 23:14:19,067 INFO [RS:0;jenkins-hbase4:41069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41069 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:14:19,073 DEBUG [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/oldWALs 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41069,1689289892207 2023-07-13 23:14:19,073 INFO [RS:1;jenkins-hbase4:45125] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45125%2C1689289892301:(num 1689289894656) 2023-07-13 23:14:19,074 DEBUG [RS:1;jenkins-hbase4:45125] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:19,073 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:19,074 INFO [RS:1;jenkins-hbase4:45125] regionserver.LeaseManager(133): Closed leases 2023-07-13 23:14:19,074 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:19,075 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:14:19,075 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:14:19,075 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41069,1689289892207] 2023-07-13 23:14:19,074 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40551,1689289892359 2023-07-13 23:14:19,075 INFO [RS:1;jenkins-hbase4:45125] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 23:14:19,075 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:19,076 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41069,1689289892207; numProcessing=1 2023-07-13 23:14:19,077 INFO [RS:1;jenkins-hbase4:45125] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45125 2023-07-13 23:14:19,078 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45125,1689289892301 2023-07-13 23:14:19,078 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41069,1689289892207 already deleted, retry=false 2023-07-13 23:14:19,078 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 23:14:19,078 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41069,1689289892207 expired; onlineServers=2 2023-07-13 23:14:19,078 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40551,1689289892359] 2023-07-13 23:14:19,079 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40551,1689289892359; numProcessing=2 2023-07-13 23:14:19,086 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40551,1689289892359 already deleted, retry=false 2023-07-13 23:14:19,086 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40551,1689289892359 expired; onlineServers=1 2023-07-13 23:14:19,086 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45125,1689289892301] 2023-07-13 23:14:19,086 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45125,1689289892301; numProcessing=3 2023-07-13 23:14:19,087 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45125,1689289892301 already deleted, retry=false 2023-07-13 23:14:19,087 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45125,1689289892301 expired; onlineServers=0 2023-07-13 23:14:19,087 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39197,1689289890670' ***** 2023-07-13 23:14:19,087 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-13 23:14:19,087 DEBUG [M:0;jenkins-hbase4:39197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62f97f29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-13 23:14:19,087 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39197,1689289890670 2023-07-13 23:14:19,087 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39197,1689289890670; all regions closed. 2023-07-13 23:14:19,087 DEBUG [M:0;jenkins-hbase4:39197] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 23:14:19,087 DEBUG [M:0;jenkins-hbase4:39197] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-13 23:14:19,087 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-13 23:14:19,088 DEBUG [M:0;jenkins-hbase4:39197] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-13 23:14:19,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894083] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689289894083,5,FailOnTimeoutGroup] 2023-07-13 23:14:19,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894075] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689289894075,5,FailOnTimeoutGroup] 2023-07-13 23:14:19,088 INFO [M:0;jenkins-hbase4:39197] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-13 23:14:19,088 INFO [M:0;jenkins-hbase4:39197] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-13 23:14:19,088 INFO [M:0;jenkins-hbase4:39197] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-13 23:14:19,088 DEBUG [M:0;jenkins-hbase4:39197] master.HMaster(1512): Stopping service threads 2023-07-13 23:14:19,088 INFO [M:0;jenkins-hbase4:39197] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-13 23:14:19,088 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-13 23:14:19,088 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 23:14:19,088 ERROR [M:0;jenkins-hbase4:39197] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-13 23:14:19,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 23:14:19,089 INFO [M:0;jenkins-hbase4:39197] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-13 23:14:19,089 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-13 23:14:19,089 DEBUG [M:0;jenkins-hbase4:39197] zookeeper.ZKUtil(398): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-13 23:14:19,089 WARN [M:0;jenkins-hbase4:39197] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-13 23:14:19,090 INFO [M:0;jenkins-hbase4:39197] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-13 23:14:19,090 INFO [M:0;jenkins-hbase4:39197] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-13 23:14:19,090 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 23:14:19,090 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:19,090 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:19,090 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 23:14:19,090 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:19,090 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.09 KB heapSize=449.27 KB 2023-07-13 23:14:19,107 INFO [M:0;jenkins-hbase4:39197] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df74bb6d8e0e461d9f25b0a4549866f4 2023-07-13 23:14:19,111 INFO [M:0;jenkins-hbase4:39197] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df74bb6d8e0e461d9f25b0a4549866f4 2023-07-13 23:14:19,112 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df74bb6d8e0e461d9f25b0a4549866f4 as hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df74bb6d8e0e461d9f25b0a4549866f4 2023-07-13 23:14:19,115 INFO [M:0;jenkins-hbase4:39197] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df74bb6d8e0e461d9f25b0a4549866f4 2023-07-13 23:14:19,116 INFO [M:0;jenkins-hbase4:39197] regionserver.HStore(1080): Added hdfs://localhost:44557/user/jenkins/test-data/bbe04bfb-4b6c-dd17-3764-67c4552f155d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df74bb6d8e0e461d9f25b0a4549866f4, entries=119, sequenceid=899, filesize=28.4 K 2023-07-13 23:14:19,116 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegion(2948): Finished flush of dataSize ~373.09 KB/382047, heapSize ~449.26 KB/460040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-07-13 23:14:19,118 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 23:14:19,118 DEBUG [M:0;jenkins-hbase4:39197] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 23:14:19,122 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 23:14:19,122 INFO [M:0;jenkins-hbase4:39197] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-13 23:14:19,122 INFO [M:0;jenkins-hbase4:39197] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39197 2023-07-13 23:14:19,124 DEBUG [M:0;jenkins-hbase4:39197] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39197,1689289890670 already deleted, retry=false 2023-07-13 23:14:19,177 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,177 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41069,1689289892207; zookeeper connection closed. 2023-07-13 23:14:19,177 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x10160f49a8f0001, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,178 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b89e986] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b89e986 2023-07-13 23:14:19,277 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,278 INFO [M:0;jenkins-hbase4:39197] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39197,1689289890670; zookeeper connection closed. 2023-07-13 23:14:19,278 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): master:39197-0x10160f49a8f0000, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,378 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:45125-0x10160f49a8f0002, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,378 INFO [RS:1;jenkins-hbase4:45125] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45125,1689289892301; zookeeper connection closed. 2023-07-13 23:14:19,378 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7311d61f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7311d61f 2023-07-13 23:14:19,478 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,478 INFO [RS:2;jenkins-hbase4:40551] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40551,1689289892359; zookeeper connection closed. 2023-07-13 23:14:19,478 DEBUG [Listener at localhost/33781-EventThread] zookeeper.ZKWatcher(600): regionserver:40551-0x10160f49a8f0003, quorum=127.0.0.1:63267, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 23:14:19,478 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@334d58af] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@334d58af 2023-07-13 23:14:19,479 INFO [Listener at jenkins-hbase4.apache.org/41829] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-13 23:14:19,479 WARN [Listener at jenkins-hbase4.apache.org/41829] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:19,485 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:19,589 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:19,589 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-69993857-172.31.14.131-1689289886230 (Datanode Uuid e5aca8c7-38c6-4821-9a4e-fc8c7da66b61) service to localhost/127.0.0.1:44557 2023-07-13 23:14:19,591 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data5/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,592 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data6/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,594 WARN [Listener at jenkins-hbase4.apache.org/41829] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:19,597 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:19,701 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:19,701 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-69993857-172.31.14.131-1689289886230 (Datanode Uuid fbfbd7a2-bfb8-451b-9a7f-63d0ef674861) service to localhost/127.0.0.1:44557 2023-07-13 23:14:19,702 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data3/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,702 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data4/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,703 WARN [Listener at jenkins-hbase4.apache.org/41829] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 23:14:19,707 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:19,809 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 23:14:19,810 WARN [BP-69993857-172.31.14.131-1689289886230 heartbeating to localhost/127.0.0.1:44557] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-69993857-172.31.14.131-1689289886230 (Datanode Uuid 712f1a86-778d-46d5-9ce3-138d53674a56) service to localhost/127.0.0.1:44557 2023-07-13 23:14:19,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data1/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,811 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a60737-d87e-2008-b319-a18acef07b36/cluster_65507340-a3ba-9ec8-e7a5-1e6f8a31e73e/dfs/data/data2/current/BP-69993857-172.31.14.131-1689289886230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 23:14:19,832 INFO [Listener at jenkins-hbase4.apache.org/41829] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 23:14:19,958 INFO [Listener at jenkins-hbase4.apache.org/41829] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-13 23:14:20,038 INFO [Listener at jenkins-hbase4.apache.org/41829] hbase.HBaseTestingUtility(1293): Minicluster is down